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ABSTRACT 


This thesis develops and documents a research methodology 
which was designed to provide for the analysis of data 
collected from a population such as that which makes up a 
specialist/sub-specialist community. While the methodology 
is designed to apply to any specialized community, the 
application in this case has been to naval intelligence. 

In addition to the data-gathering and analysis procedures 
and techniques, the project also presents and demonstrates 
several comprehensive uses in personnel and education manage- 
ment, for the resultant data base. 

The project documentation includes samples of all data- 
collection instruments utilized, seurce programs written for 
data base construction and processing, and a "User's Manual" 
which provides instructions for accessing the information 


files. 
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SUMMARY 


The project described in this report was designed to 
produce a methodology which would make it possible to study 
and document a diverse group of individuals who have been 
identified in some way as a work community. The researchers 
utilized the methodology to study the group of specialist and 
sub-specialist officers which make up the naval intelligence 
community. Aspects of this methodology were borrowed from 
the current literature and were modified to fit the circum- 
Stances at hand. The result was a unique set of procedures 
Which could be adapted to apply to a wide range of problem 
areas associated with the management of such communities. 

The three main objectives of the research were: (1) To 
provide a fresh and unbiased look at the intelligence community 
to determine what it was and what it did, (2) to forma data 
base which would be versatile enough to answer a wide range 
of questions from several fields of interest, and (3) to 
provide enough generality in procedures to allow the methodol- 
ogy to be adapted to fit many different community applications. 

A background description of the community under study was 
made first, explaining what it was supposed to do and how it 
fit into the national intelligence organization. Data for 
this section was available in the open literature, and sources 
were primarily organizational charters and mission statements 


published by the organizations within the community. There 
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was then presented a discussion of morphological analysis, 
the research scheme which tied the whole project together. 

In the morphological approach to analysis, certain 
parameters are selected within which a wide range of data 
is collected. As the data develops, they diverge in many 
‘different directions. Constraints must be applied to control 
the amount of data collected within a given parameter and to 
bring about convergence, or focusing, of data which is 
relevant to the study. The various solutions which result 
from this convergence of data can be applied to any number of 
interest areas, depending on the value criteria the analyst 
chooses to apply. Careful control of the methodological process 
can result in a vast data base which has enormous potential. 
The morphological approach was tied to data collection schemes 
including questionnaires, interviews, and Delphi instruments, 
and maximum use was made of available computer resources. 

Implementation of the methodological process included 
developing procedures for the computer generation of data- 
gathering forms and the subsequent data manipulations necessary 
when the forms were returned. The research also included 
study trips to several organizations within the intelligence 
community and the interviewing of key personnel at each 
location. As the large amount of raw data was collected, 
codified, and filed, the morphological description of the 
community began to take shape and is presented empirically in 
the extensive appendices of this report. Several methods 


were Suggested for statistical analysis of the data and brief 
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analyses were carried out in both functional and educational 
interest areas. The results of these analyses were presented 
in both verbal and graphical form and can be of interest to 
Manager and educator alike. Careful methodological checks 

were performed throughout the project, statistically validating 
both the data and the methods used to collect it. 

One of the most important features of this project lies 
in the fact that it was accepted by the community with over- 
whelming response. The researchers realized at the beginning 
that they were dealing with a group of highly specialized 
professionals and would require their full cooperation in 
order to conduct a valid study. The data-gathering instruments 
were therefore designed both to inform the respondents of the 
Bempece s peegrecs Gna to solisit the necessary information, 
while wasting as little time as possible in administrative 
detail. The researchers gave the population a sense of 
participation through Delphi feedback techniques and the 
population rewarded the researchers, in turn, with an unheard 
of 85% response. 

There were several spin-offs from the project and these 
included new uses for the available computer facilities. The 
conclusion discussed them, provided ideas for applications of 
this methodology to other communities, and offered recommenda- 
tions to anyone who ake) 88 decide to undertake such a project 


in the future. 
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I. THE PROBLEM 


A. INTRODUCTION 

This research project was precipitated by the establish- 
ment of a masters degree program in naval intelligence at 
the Naval Postgraduate School in Monterey, California. The 
new curriculum was planned to prepare intelligence specialist 
and subspecialist officers to meet the growing challenges of 
an increasingly complex world situation. 

A group of students in the curriculum began discussing 
whether or not it was possible to measure the effectiveness 
of a course of study. They quickly realized that in order to 
analyze the value of a curriculum, it was first necessary to 
learn something about the community with which the curriculum 
was associated. They recognized that there was no tangible 
way to measure the effectiveness or value of the Naval 
Intelligence Curriculum since the status quo of the naval 
intelligence community had not been effectively documented. 
The group of reSearchers then began the adaptation and 
formulation of a reSearch methodology which would result in 


an accurate analysis of any specialized group or community. 


B. OBJECTIVES OF THE RESEARCH 
This research project was designed with three main 
objectives in mind. These objectives expand outward in their 


applicability and contributions to knowledge. 
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1. Primary Objective 

The primary objective was to provide a fresh and 
unbiased look at a group or a community, in this case the 
Naval Intelligence Community, in an attempt to determine in 
the most basic terms, what the body is and what it does. 
-Some standard procedures were used in addition to using 
several relatively new methods for quantifying heretofore 
unquantifiable attributes and information. A significant 
amount of data was collected by these combined processes, and 
in addition to contributing to the task of describing the 
community, the data were used for statistical analysis in an 
attempt to discover useful information beyond that which 
could be derived by more conventional methods. 

2. Secondary Objective 

A secondary objective of the research project was to 
initiate procedures for the formation of a complete and 
exhaustive data base. The information contained in the data 
base was collected from officers currently occupying related 
billets and included biographical as well as educational and 
functional information concerning both the officer and his 
billet. The ultimate application for this data base, if it 
is kept current, can be its use as a dynamic measuring device. 
Not only can it reflect normal day to day changes, it can also 
monitor and record alterations brought about by such variables 
as the increasing number of intelligence specialists and 


Subspecialists with postgraduate education entering the 
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community. As such, the data base can be used not only by 
the Board of Curriculum Review as a source of empirical data 
on’ which to base its judgements concerning curriculum 
effectiveness, but also by the Director of Naval Intelligence 
as a source of information concerning the overall status of 
naval intelligence as a functioning body. 
3. Tertiary Objective 

This project involved carrying out an analysis 
directed at a select group of individuals. New methods were 
developed to handle the gathering of data. New procedures 
and facilities were designed to enable the statistical 
manipulation and storage of the data. Since these methods 
and procedures could easily be modified so that they were 
applicable to studies in other areas and of other communities, 
a tertiary objective of this project was to provide an 
instrument and methodology which could be used by other 
curricula and by other organizations in similar research 


efforts. 


C. ENVIRONMENTAL CONTEXT OF PROBLEM 

Prior to commencing development of methodology and becoming 
imvolved in the specifies of the sesearch per se, the reader 
should acquire an understanding of the general structure and 
scope of the so-called "intelligence community." The term 
"intelligence" has a variety of meanings, depending upon the 
context in which it is used. The word can be used to refer to 


a body of knowledge as well as the actions or processes which 
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are used by formal organizations to produce that knowledge. 
The term “community” can refer to the national intelligence 
organization as being an entity in its own right as well as 
being the framework within which naval intelligence must 
operate. The remaining paragraphs in this section discuss 
the national intelligence organization as this framework and 
present an overall view of naval intelligence in light of its 
stated missions and functions. 

1. National Intelligence 

In its broadest sense, the term "intelligence 

community" is all-inclusive and refers to the many agencies 
of the Federal Government which collect information and 
process it into intelligence. As such, the intelligence 
community usually includes the Central Intelligence Agency 
(CIA), the intelligence components of the Department of State, 
the Department of Defense (DOD), the Defense Intelligence 
Agency (DIA), the Departments of Army, Navy, and Air Force, 
the National Security Agency (NSA), the Federal Bureau of 
Investigation (FBI), and the Atomic Energy Commission (AEC). 
In some cases, Such as that of the Defense Intelligence Agency, 
intelligence is the sole reason for that organization's 
existence. In other cases, such as the Atomic Energy 
Commission or the Department of Defense, intelligence is 
necessary in order to allow the agency to perform some 


broader function. 
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a. Authority 

Frequently the intelligence requirements and 
activities of two or more agencies coincide. When that is 
the case, special purpose committees coordinate the necessary 
collection and production efforts. To provide coordination, 
the National Security Act of 1947, as it has been amended, 
established the National Security Council (NSC), the Director 
of Central Intelligence, the Central Intelligence Agency, and 
indirectly, the Defense Intelligence Agency. 
by Components? 

(1) National Security Council. The NSC oversees 
the United States Intelligence Board (USIB) which it created 
to coordinate the activities of the members of the intelligence 
community concerning national security. Members from most of 
the community agencies make up the USIB committees which are 
permanent in nature and which meet regularly to assess develop- 
ments in their areas of concern. Acting on the advice of the 
United States Intelligence Board (USIB), the NSC issues 
directives which define the roles of the various agencies 
with respect to coordination of activities under the Director 


of Central Intelligence. 


lenis description of the Components of the National 
Intelligence Organization is a condensation of material found 
in: Intelligence for Naval Officers — Supplement NAVPERS 
10889-C(S), (Washington, D.C.: Naval Personnel Program 
Support Activity, 1968), pp. 1-23. 
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(2) Director of Central Intelligence. The 
Director of Central Intelligence coordinates the activities 
of the entire intelligence community, acts as the President's 
principal intelligence advisor, is the head of the CIA, and 
is chairman of the USIB. 

(3) Central Intelligence Agency. The CIA, with 
the Director of Central Intelligence as its head and under 
the direction of the NSC, coordinates the activities of the 
government intelligence departments and agencies as they 
relate to national security. Its principal duties are to 

(a) Advise the NSC and make recommendations concerning 


intelligence activities and coordination of intelligence 
activities as they relate to national security. 


(b) Correlate and evaluate national security intelligence, 
providing for dissemination as appropriate. 


(c) Perforin, for the mutual benefit of ail ayencies 
concerned, those common functions which the NSC deems 
appropriate. 


(a) Perform other intelligence related functions and duties 
as the NSC directs. 


(4) Defense Intelligence Agency. The Defense 
Intelligence Agency (DIA) was established as an agency of the’ 
Department of Defense by DOD Directive 5105.21 of 1 August 
1961, wnder provisions of the National Security Act of 1947, 
as amended. As such, it operates under the direction, 
authority, and control of the Secretary of Defense. The DIA 
was established in order to eliminate duplicate intelligence 
functions and facilities within DOD and to provide for more 
efficient allocation and management of critical eeinaeance 


resources. The functions of DIA are to: 
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(a) Satisfy the intelligence requirements of the major 
components of the DOD. 


(b) Obtain the maximum economy and efficiency in the 
allocation and management of DOD intelligence resources. 


(c) Review, coordinate, and supervise the execution of all 
DOD intelligence functions whether they are assigned to 
the DIA or are retained by or assigned to the military 
departments. 

In general, the functions performed by the 
DIA are basic and are of interest to all military services. 
For example, the Defense Intelligence School (DIS) in 
Washington, D.C. provides various levels of intelligence 
training for military personnel of all services. 
2. Naval Intelligence 

If the all-inclusive body of intelligence knowledge 
is compared to a large pyramid, the tip might represent the 
most highly refined estimates needed for national policy 
decisions, and somewhere in the middle cross section would 
fit naval intelligence, where it converts the flow of raw 
data into contributions to the total body of knowledge 
surrounding it. As a segment of the pyramid, naval intelligence 
utilizes those parts above and below it effecting the 
successful accomplishment of its assigned responsibilities. 
It thereby produces intelligence which will directly serve 
naval commanders in problem solving and decision making, and 
indirectly contributes to the entire intelligence efforts at 


the national level. 
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a. Definition 

The term "Naval Intelligence" usually is employed 
to describe the formal organization that collects, produces, 
and disseminates intelligence information of naval interest. 

b. Components 

The Naval Intelligence organization is headed by 
the Commander, Naval Intelligence Command (COMNAVINTCOM) . 
The Commander, in turn, is a member of the staff organization 
as Assistant Chief of Naval Operations for Intelligence. 

(1) Commander, Naval Intelligence Command. The 
Office of Naval Intelligence (ONI) was established by the 
Secretary of the Navy in 1882. Historically, the term ONI 
has denoted all aspects of naval intelligence including the 
naval attaché system, naval intelligence postyraduate and 
language schools, amphibious intelligence, air intelligence, 
fleet intelligence centers, operational intelligence, commerce, 
travel, photographic intelligence, scientific intelligence, 
’ security policy, telecommunications, censorship, counter- 
intelligence, and investigations. The Naval Intelligence 
Command was created by a Navy Department reorganization in 
n967. 

(a) Mission. To direct and manage the 


activities of the Naval Intelligence Command to ensure the. 
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fulfillment of the intelligence, counterintelligence, 


investigative, and security requirements and responsibilities 


of the Department of the Navy. 


the Commander, Naval Intelligence Command shall: 


(1) 


(2) 


(3) 


3) 


(5) 


(6) 


(7) 


(8) 


(9) 


(10) 


2 


(b) Functions. To accomplish this mission, 
3 


Command the Headquarters, Naval Intelligence Command 
(NAVINTCOMHQ) and assigned shore (field) activities. 


Direct and coordinate intelligence collection, 
production, and dissemination to satisfy Department of 
the Navy intelligence information requirements and 
Defense Intelligence Agency (DIA) tasking. 


Direct the development, management and operation of 
Ocean Surveillance information management systems. 


Direct Department of the Navy participation in the DOD 
Intelligence Data Handling System (IDHS) and in the 
development, management and support of Navy intelligence 
information systems. 


Fulfill the investigative and counterintelligence 
responsibilities of the Department of the Navy (less 
those combat related counterinteliligence matters within 
the functional responsibilities of the Marine Corps). 


Participate, as appropriate, in matters pertaining to 
Undersea Warfare intelligence, 


Direct intelligence support of the participation in 
Special Warfare and other designated activities as 
appropriate. 


Act as Navy Special Security Officer (SSO) and manage 
the systems for the protective handling and dissemina- 
tion of Special Intelligence and Special Activities 
materials within the Department of the Navy. 


Provide a translation service for the Department of the 
Navy. 
Participate in and provide intelligence inputs to naval, 


joint and national plans and policies and Navy studies 
and analyses, 


Naval Intelligence Command Missions and Functions, 
PAVINTCOMEINST S48082B dated’ 10 Oct’. 1970, pp. 1,2. 


8 


Ibid. 
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(11) 


(12) 


(13) 


(14) 


(15) 


(16) 


(17) 


(18) 


Determine requirements for research, development, test 
and evaluation of new and improved intelligence 
equipment and techniques. 


Prepare and submit intelligence inputs to Navy Program 
Objectives Memoranda, Office of the Secretary of Defense 
functional area reviews, and other pertinent planning 
and programming documents in collaboration with other 
appropriate commands and agencies. 


Serve as major claimant for the Naval Intelligence 
Command budget, authorize Expense Operating Budgets 
(EOB's) to assigned shore (field) activities of the 

Naval Intelligence Command, and provide guidance to 

these shore (field) activities relative to the allocation 
and utilization of funds provided for intelligence, 
counterintelligence, investigative and security programs. 


Inspect and appraise the components of the Naval Intel- 
ligence Command to ensure the maintenance of efficiency, 
discipline, readiness, effectiveness and economy in 
utilization of assigned resources. 


Collaborate in matters relating to the training of 
personnel and the organizing, training, and equipping 
of units for assignment to intelligence, counter- 
intelligence, investigative and security duties. 


Sponsor requirements for manpower and personnel for 
designated Navy intelligence activities and functions as 
sponsor for the Naval Reserve intelligence and Air 
Intelligence programs; function as the Designator 
Sponsor for 163X, 662X, and 762X officers and NEC 
Sponsor for YN-2505 and 9592; and act as Career Program 
Manager for the Intelligence and Counterintelligence 
Career Development Programs. 


Maintain liaison with the Defense Intelligence Agency, 
and with other organizations on intelligence matters as 
required. 


Function as the Navy point of contact for Department of 
the Navy personnel assigned to the Defense Attaché 
System. 

(c) Organization. See Appendix A, 


(2) Assistant Chief of Naval Operations 


(Intelligence). The Director of Naval Intelligence (DNI) is 


responsible for performing the intelligence functions for the 


Chief of Naval Operations who is required by Navy Regulations 
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to "collect, evaluate, and disseminate all types of intel- 
4 


ligence information required within the Naval Establishment." 

(a) Mission.” To implement the responsi- 
bilities of the Chief of Naval Operations with regard to 
intelligence, counterintelligence, investigative and security 
matters; to serve as the principal staff advisor to the 
Secretary of the Navy and the Chief of Naval Operations in 
related plans, programming and policy matters; to represent 
the Department of the Navy on the United States Intelligence 
Board and with other agencies in intelligence matters; and to 
advise and assist officials of the Department of the Navy in 
matters of protocol and liaison with foreign officials. 

(b) Functions. © 


(1) Exercises for the CNO command responsibility relating 
to the Naval Intelligence Command. 


(2) Formulates policy with regard to counterintelligence 
and investigative matters within the Department of the 
Navy. 


(3) Exercises overall direction in matters pertaining to 
the security of military information including the 
protection and control of classified information, 
disclosure of classified information to foreign 
governments and international organizations, the security 
review of all Navy information proposed for public 
release and the support of National Censorship and 
censorship planning. 


(4) Provides intelligence staff support to the SECNAV, CNO, 
VCNO, the DCNOs and DMSOs. 


4 tntelligence for Naval Officers — Supplement, p. 8. 


OMilecuone and Functions of the Director of Naval Intelli- 


gence, OPNAVINST 5430.48 dated 26 APR 1974, pp. 1,2. 


ahewlsle 
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(5) 


(6) 


(7) 


(8) 


(9) 


(10) 


(11) 


(a2) 


Partle@paces in them formulation, coordination and 
evaluation of national, joint and naval intelligence 
estimates. 


Formulates policy with regard to the control, protection, 
dissemination and use of Special Intelligence and 
Special Activities materials within the Department of 
the Navy. 


Exercises overall responsibility and authority within 
the Department of the Navy in matters pertaining to 
intelligence requirements, collection, production and 
dissemination, formulates and coordinates related policy; 
advises concerning intelligence equipment, doctrine and 
techniques. 


Exercises overall coordination and direction in matters 
pertaining to Undersea Warfare Intelligence and collabo- 
rates in the conduct of related special programs with 
the DCNO (Submarine Warfare). 


Sponsors requirements for research, development, test 
and evaluation of systems, equipment and techniques 
relating to intelligence, counterintelligence, investi- 
gations and security within the Department of the Navy 
and collaborates on actions to fulfill these require- 
ments. Coordinates and collaborates with the Director, 
Research, Development, Test and Evaluation in assuring 
the satisfaction of these requirements. 

Coordinates various programs of mutual interest with the 
Director, Anti-Submarine and Tactical Electro-Magnetic 
Programs, and appropriate other agencies and offices of 
the Department of Defense and the Department of the Navy. 


Provides a point of contact for liaison with foreign 
officials accredited to the Department of the Navy and 
advises and assists on matters relating to protocol and. 
Srrvelal. forevgn Visitors. 


Sponsors the intelligence, counterintelligence, investi- 
gative and security of information programs of the 
Department of the Navy; acts as coordinator for the Navy 
portion of the General Defense Intelligence Program and 
sponsor for all but the Mapping, Charting and Geodesy 
Program element; determines related program objectives, 
resource requirements and time phasing; and presents and 
justifies these programs and their supporting budgets 
including special reviews by the Secretary of Defense 
for designated intelligence programs. 
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(13) Participates in the deliberations and activities of 
the United States Intelligence Board as representative 
of the Department of the Navy, acts as the Navy member 
of the Military Intelligence Board and participates in 
Other interdepartmental, Department of Defense and 
joint service committees as appropriate. 


(14) Determines the effectiveness and responsiveness of 
intelligence, counterintelligence, investigative and 
Security activities to meet current, contingency and 
mobilization requirements of the Department of the Navy, 
and collaborates on actions to correct deficiencies. 


(15) Collaborates with the Bureau of Naval Personnel in 
establishing training, career development and mainte- 
nance of readiness programs relating to the intelligence, 
counterintelligence, investigations, and security 
matters within the Department of the Navy. 


(16) Acts as the primary point of contact with DIA, CIA, NSA, 
FBI, Department of State, the service intelligence 
agencies, and other foreign and domestic agencies as 
appropriate on intelligence, counterintelligence, 
investigations, and security matters; serves as the 
Single point of contact within the Department of the 
Navy for coordinating the forwarding of Department of 
the Navy intelligence requirements and for maintaining 
liaison to ensure their satisfaction. 


(c) Organization. See Appendix A. 


D. METHODOLOGY 

This discussion of methodology takes two parts. First, 
the selection of an overall methodology, to govern the research 
and within which to construct the research model, is discussed. 
Then the discussion turns to the selection of data-gathering 
techniques employable within the methodology. The governing 
methodology for this research was morphological analysis. 

1. Morphological Analysis 

In recent times, the source of new concepts and basic 

scientific knowledge has consisted not only of the "natural 


order“ but also of the structures and organizations created by 
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man. The collection of concepts within cybernetics, for 
instance, were derived jointly from studies of animal nervous 
systems and man-made control systems. Another powerful 
methodology was thereby created simply through studying systems 
"constructed to occupy some of the gaps in the natural order."/ 
The pursuit of any research objective as broad as a 
"description" of the naval intelligence community demands a 
methodology which can capitalize on that very broadness. 
Morphological Analysis, as created by Fritz Zwicky (California 
Institute of Technology), offers a unique and challenging 
answer to that problem. The morphological approach concerns 
itself with the development and practical application of 
basic methods which will allow the researcher to discover and 
analyze structures or morphological interrelations among 
objects, phenomena, and concepts, and to explore the results 
to be gained.” The application of morphological analysis to 
this research allows great flexibility in data-gathering 
techniques, since it "uses whatever methodologies are available 
to arrive at the most complete and unbiased representation of 


the structure of the problem..."? 


a Zwicky and A. G. Wilson, Eds., New Methods of 


Thought and Procedure, New York: Springer-Verlag New York, 
imen, 1967, p. 302. 


Og, jo, 2IBe 


2ipia. p. 298. 


30 





Morphological analysis begins with a clear statement 
of the problem to be studied. In epic research, the problem 
statement is: Describe the naval intelligence community (see 
diagram I). Once the assumption is made that there is such a 
thing as a "naval intelligence community," then there are 
posed two mutually exclusive hypotheses: 


Hypothesis a: The naval intelligence community can be 
described (in some manner). 


Hypothesis b: The naval intelligence community cannot be 
described (in any manner). 


Throughout the research, the identification of elements held 
in commonality will be the primary means to prove or disprove 
these qualifying hypotheses, 
a. Establishment of Parameters 

The next step in the morphological model shown 
in diagram I is the establishment of parameters to be used in 
describing the community. This form of analysis requires 
visualizing all possible interrelations without prejudging 
the values of any of them. Furthermore, morphology in its 
proper form takes nothing for granted, but must view all 


at The choice of parameters 


phases and aspects of the problem. 
governing the research results in a lengthy list of elements 
which will later become variables in statistical manipulations. 
These elements make up the broader parameters: 


(1) Organizational Descriptors, Identification 


of various intelligence organizations, their locations, 


Nests ae Pe 


SL 





DIAGRAM I 


THE MORPHOLOGICAL APPROACH 


Problem Statement 


"Desertbe the naval tntelltgence community" 


Establish the Parameters to be Utilized 


Educattonal Organtzattonal 
J/E | | TU\ ee 
DIVERGENCE 


Establish the Constraints on the Research 


TE a Geographical 
> ake as 
ht 
Apply the. =e Criteria 


Solution 1 


Solutton n 


32 





structural components, stated missions, functions, and 
manning requirements. 

(2) Personal Desertptors.  fcentification and 
localization of the personnel assigned within naval intel- 
ligence; their ages, ranks, and other pertinent biographical 
data are included in this parameter set. 

(3) Functional Descriptors. Identify and 
describe what the organization within the community, and the 
billet within the organization, do in terms of functions and 
outputs. 

(4) Educational Descriptors. Identify the 
educational backgrounds of the personnel assigned to 
intelligence organizations. These factors include not only 
educational credits, but levels of expertise gained through 
experience, as well as formal training. 

State-of-the-art methodologies which are used to 
gather data on these parameters do exist. One such methodol- 
ogy, drawn upon heavily for this research, is task analysis. 
An important part of the management theory of researchers 
Henri Fayor and Frederich Taylor was the concept that 
managers and supervisors at every level should utilize 


a 


Occupational analysis as a tool. This analysis was defined 


as what, how, and why people did their jobs. The popular. 


1leobert Butterworth, Task Analysis of U.S. Navy Enlisted 
Radiomen with Emphasis on Technical Controllers, Master's 
Thesis, Naval Postgraduate School, Monterey, California, 
ors De 6. 


33 





modern-day term for this procedure is job-analysis, task- 
analysis, or vocational analysis. Job analysis was employed 
by the U.S. Army during the first world war as a means of 
identifying different jobs and assigning them to their proper 
components. Following the war, educators began employing 
vocational analysis as the basis for designing formal job 
training courses whose purpose was preparing students to 
asSume various jobs. 

Several methods of task analysis have been 
developed and attempted. Essentially, these methods fall 
into two categories, depending on the approach to the study 
being either task-centered or behavior-centered. The general 
thrust of the task=-centered approach is todisregard the 
characteristics of the incumbent in the position and onlv 
describe the scope and nature of the task involved. Methods 
involved here include personal interviews, observations, and 
relating other sources of tasking information to provide 
general outlines and specific details of ideal task content.) 
The behavior method attempts to describe the task in terms of 
the behaviors that are necessary and inherent to the successful 
performance of that particular task. This system basically 
provides a means of explaining what a person does and how he 


does it while accomplishing (or failing to accomplish) a 


li : 2 : 

ewaltex Charles Mattox, Jr., Job Dimension Analysis of 
Naval Communications Managers, DisSertation, Naval Postgraduate 
School, Monterey, March 1973, p. 7-10. 
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ae The methods of task analysis which were 


designated task. 
modified to suit the purposes of this research lend themselves 
to computerization and manipulation. Task analysis tends to 
reduce reliance on subjectiveness and places more emphasis 
on real data. 

Bringing methodologies such as task analysis to 
bear on the problem of compiling the parameters mentioned 
above is made more difficult by the reminder that there is a 
tendency to concentrate on those elements which are easily 
quantifiable, and ignore those that are difficult to measure, 
even though their relative weight in the problem may be high.?* 
Examples of elements with the descriptive parameters which fit 
that warning exist mostly among the personnel aspects: 
attitudes, cooperation and competition levels, prejudices and 
biases, moral values, and more. Within the methodology the 
researcher must offset this tendency by incorporating the 
effects of these elements which cannot be quantifiably 
expressed. 

b. Establishment of Constraints 
As the parameters are broken down into component 


elements (later variables), this stage of the analysis 


becomes "divergent" (Diagram I). At this point, constraints 


--1had. p. oe 


14 owicky and Wilson, New Methods of Thought and 
meocedure, p. 304. 
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must be imposed to bring the analysis back into line with 
reality and practicability. The constraints imposed on this 
research showed their greatest impact on the instruments and 
actual techniques employed (to be discussed later), but they 
can be listed generally as: 

(1) Methodology and Procedural Constraints. The 
availability of personnel to data-gathering techniques, 
applicability of task analysis procedures to this community, 
and security considerations. 

(2) Geographical Constraints. The physical 
locations of many organizations and billets precluded on-site 
visits by researchers. 


(3) Data-Handling Constraints. Time and computer 


administrative billets within intelligence organizations, 
and only those with intelligence functions as primary duties 
(see procedural section). 

If the parameter definitions within the model 
represent the divergent area, then the Bee eesine apeiliea= 
tions bring about an area of "convergence" (diagram I). It 
is within this phase of the research that the value criteria 
underlying the whole project were applied to the data which 
had been amassed. In keeping with the stated objectives of 
this project, the ata base resulting from a morphological 
approach such as the one outlined here can be made applicable 


to any number of value criteria. The data may be viewed in 
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light of its organizational features, educational elements, 
or any number of slants and interests. What emerges from 
the process of problem definition, parameter study, and 
constraint application, is then a description of the naval 
intelligence community in the form of a data base able to 
provide statistically relevant information for a variety of 
uses. 

2. Data Gathering Techniques 

One of the objectives of the research was to examine 
some intelligence aspects which had never before been studied. 
This would mean collecting and analyzing information which 
was not recorded anywhere; i.e., intuitive feelings, 
information carried around in people's heads, information 
rarcly written down and even more rarely compared or discussed 
with others. The only logical way to get at this information 
was to question the people involved. 

A wide and varied assortment of instruments was 
available for use. Paramount in the selection of instruments 
was the requirement to find a compromise between excess 
complexity and excess brevity; i.e., to provide for the 
collection of all essential facts without wasting so much of 
the respondent's time that he became unwilling to cooperate. 
Another matter which had to be considered in selecting the 
instruments was the requirement for a format which would not 
only facilitate data acquisition but would also aid subsequent 


coding and handling procedures. 
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Six of the instruments which were considered are 
listed and discussed below. 
a. Questionnaire 
A set of questions which is sent to an individual 
in order to obtain personal and other statistically useful 
information. The simplicity of a questionnaire lends itself 
readily to the research since it provides a quick means of 
gathering base-line and background data. 
b. Delphi 
A refinement of the questionnaire in that 
responses to the initial collection effort are collated and 
returned to the original respondents. The respondents are 
then asked to re-evaluate their own responses in view of the 
responses of the overall population. Since the respondents 
do not have personal contact, there is no chance for pressure 
to be exerted. This technique is particularly powerful 
because it provides feedback and promotes continued partici- 
pation in the project. 
c. Brainstorming 
A meeting in which all participants are briefed 
on a problem and then are encouraged to disregard their 
inhibitions and to express their spontaneous thoughts 
concerning the topic. 
ad. Pol 
A canvassing of individuals selected by quota or 


at random in order to obtain opinions for analysis. This_ 
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technique is rather vague and general but is often useful 
for its timeliness and statistical relevance. 

e. Interview 

A formal consultation, usually on a one-to-one 

basis, to evaluate some characteristic or aptitude. The 
drawback of this approach is that it necessitates an on-site 
visit by the researcher and must therefore be limited by time 
and expense. The interview is, however, one of the most 
thorough forms of data gathering available. 

f. Participatory Observation 

A personal visit with the respondent in which 
the information collector remains with the respondent through 
a complete work cycle, observing his routine and recording 
data as appropriate. As with the interview, the observation 
requires an on-site visit. The advantages of such a technique 
usually outweigh that problem, however. 

Intrinsic in the selection of the instrument was the 
selection of the medium.to be used. Four possibilities were 
considered: Personal contact, telephone, mail, and a 
combination of one or more of these three. 

Detailed descriptions of the instruments and media 
actually employed are given in the next section, RESEARCH 
PROCEDURES. 

3. Data Handling Considerations 

Inherent in the morphological approach was the 

requirement for the collection of vast amounts of data even 


for a simple case. Because of the complexity of the realm 
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of intelligence and because of the number of people and 
billets en which data had to be collected, it was obvious 
from the beginning that heavy uSage of a computer was 
absolutely essential for the completion of the project. It 
was recognized though, that the Statistical Package for the 
Social Sciences (SPSS) program would not be sufficient. For 
this reason, one individual assumed responsibility for the 
development and documentation of the required computer 
programs. Briefly stated, data handling for this project 
included coding of information, storage within a data file, 
and the use of standardized programs and methods for statis- 
tical manipulations. Additionally, provision was made for 
computer preparation of the forms and correspondence required 


for the exchange of data between researchers and popuiation. 
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II. RESEARCH PROCEDURES 


aye ESTABLISHING THE PROBLEM STATEMENT 

This reSearch project was initiated to analyze the 
intelligence community and to arrive at some documentation 
of its present status. It was assumed that this statement 
of the status quo could then be used as the base line against 
which to measure the effectiveness of the new naval intelli- 
gence curriculum and its impact on the community. Morpholog- 
ical analysis was the methodology selected to provide the 
required descriptive material, and the framework on which to 
build the research. 

The first step in a morphological analysis, according to 
Zwicky, is stated as: "The probiem which is to be solved 


- The problem statement for 


must be exactly formulated." 
this research was: Describe the naval intelligence community. 
Immediately, the assumption was made that there indeed was 
such a thing as a naval intelligence community, and the 
resulting hypothesis was that the community could somehow 
be described. 

The decision was made to begin the research with the 


smallest unit in the community, the individual. A request 


was sent to the Bureau of Naval Personnel for a complete 


lowicky and Wilson, New Methods of Thought and Procedure, 
p.. 285% 
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listing of all those personnel who were occupying intelli- 
gence billets. A billet listing containing 1040 entries was 
received, and from this list the sample population was 
selected. 

Prior to beginning the billet selection process the 
researchers imposed several constraints in order to control 
the volume of data about to be collected and for other 
reasons which will be discussed later. In addition, the 
parameters within which the description was to take place, 


were eStablished. 


B. PARAMETERS AND VARIABLES 

In his description of the morphological method, Fritz 
Zwicky lists as the second step the identification of the 
problem's parameters: "All of the parameters which might 
enter into the solution of the given problem must be localized 


f The next stage of the research called 


and characterized." 
for masses of data to be collected against the naval intelli- 
gence community; data that in some way could help in the 
description of the community. To handle this data efficiently 
and to put it into a form easily manageable by the available 


data processing equipment,” the variables to be collected were 


characterized and organized into four broad parameter groups. 


2tbid. p. 285. 


3n complete discussion of the data processing involved 
in the research can be found in sections IV and V and the 
appropriate appendices. 
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During the variable selection process, emphasis was placed 
on seeking those variables which could provide data to more 
than one parameter area. As well as applying to as many of 
the four parameter groups as possible, the individual variables 
were also selected with consideration for how they were to 
be collected. Collection requirements within the four 
Parameter areas (organizational, personal, functional, and 
educational), as well as the variables themselves, are 
discussed below, 
1. The Organizational Parameter 
The morphological description of the community 
required, after the initial Bureau of Personnel billet listing, 
an accurate listing of the organizations officially existing 
within the community. The variables within the organizational 
parameter were selected for their usefulness in identifying, 
naming, locating, and characterizing the various commands 
under study. 
a. Variables Within the Parameter 

(1) Command Name (VARO0O1). The organizations 
were identified first by their command name. The list of 
commands to be addressed in the research was generated after 
a process involving various external and internal constraints 
(discussed later) and included 119 separate organizations. . 

(2) Billet Sequence Code (VARO02). A number, 
known as a Billet Sequence Code (BSC) is assigned to each 


billet in a naval organization. VARO02 was used as one method 
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of identifying and addressing a billet within an organization 
by referencing the appropriate BSC. 

(3) Billet Title (VAROO3). The billet titles 
collected exhibited some similarity from one organization 
to another, but were not necessarily compatible across the 
community. A title can tell a great deal about a billet in 
one place and very little about the billet somewhere else 
so no effort was made to name billets in any particular manner. 

(4) Unit Identification Code (VAROO4). A Unit 
Identification Code (UIC) is assigned to every naval command 
as a means of identifying individual commands numerically. 
VARO0O4 was used in the data file as another convenient way 
in which to address individual commands within the population, 
VAKI04 was aiso keyed to a file of individual command mailing 
addresses to facilitate postal procedures for the research. 

(5) CONUS or Overseas Code (VAROO5). This code 
was assigned within the file to indicate the general locations 
of the organizations, grouping them into rough geographical 
areas: CONUS (continental United States), Europe, Pacific 
area, Atlantic-Mediterranean afloat, and Pacific afloat. 

(6) Country Code (VAROO6). The country code 
designated the state (if in CONUS) or the country in which 
the organization was located. It was thought that the UIC 
(VARO04) would be used for clerical purposes, while the CONUS 


code and this code would be uSed for analytical purposes. 
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(7) Billet Subspeciality (VARO16). This 
organizational variable identified those billets within a 
command that have been designated as "P-coded", or assigned 
a sub-specialist manning requirement. The sub-speciality 
codes are assigned by the Bureau of Naval Personnel. The 
billets so designated require an officer to fill them who 
holds a sub~speciality, usually gained through graduate 
education. The capability for identification of such billets 
within the organizations studied was thought to be valuable to 
the research. 

(8) Comments (VARO83). Throughout the data- 
gathering stages of this project, emphasis was placed on 
soliciting and recording pertinent comments from the population 
regarding subjects of interest to the research. The comments 
regarding organizational factors were condensed and recorded 
as addressable variables. 

b. Structural Analysis 

The gathering of organizational data required an 
understanding first, of how the organizations were structured 
internally and second, how they fit into the overall intelli- 
gence Structure. 

A feature common to the various commands studied 
during the research period was the propensity for periodic 
reorganization. During the course of the project, several 
major reorganizations took place: In the Pacific area, 


several complete intelligence organizations and many integral 
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parts of others combined into the joint-service agency known 

as Intelligence Center Pacific (IPAC), located in Camp Smith, 
Hawaii. The Fleet Intelligence Center Atlantic (FICLANT) 

and the Fleet Intelligence Center Europe (FICEUR) began the 
process of merger on the east coast. Finally, the Headquarters 
“Naval Intelligence Command (NAVINTCOM) itself began to 
reorganize. This fluidity in the community made the production 
of a structural analysis (a process by which the organizational 
blueprint of a specific command is recorded) difficult at best. 
Pie structural Giagrams applicable (at this writing) to the 
commands addressed are contained in Appendix A. 

The process of structural analysis normally is a 
relatively simple one requiring only the collection of 
organizational diagrams and applicabie instructions from the 
various commands and assembling them in accordance with 
stated relationships. This process may more accurately be 
called "formal" structural analysis, since it produces the 
formal, legal blueprint of an organization. A more imprecise 
and difficult analytical process is that which attempts to 
define what might be called the "informal" structure within 
an Organization. The informal structure may not necessarily 
follow any formalized structural guides but characteristically 
transcends such guides. The informal structure within a 
command is uSually based on personalities and on trust, 
respect, and mutual confidence among key personnel. The 


officers occupying key slots in the structure are usually the 
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organization's most productive and competent. Since this 
research depended so much on individuals for data-gathering, 
it was very important that the informal structures be 
identified as accurately as possible and that billets 
selected for special study within a command be among those 
considered by the informal structure as important to the 
organization's mission Success, The process of identifying 
those billets, usually by personal discussions with organiza- 
tion members, is the process of informal structural analysis 
itself. The researchers found virtually no way of identifying 
the informal Structure except through personal interviews and 
discussions. Analysis was limited to those commands actually 
visited by research team members and was baSically carried 
out aS a part of the key-billet interviews discussed below. 
The identification of the informal structure within each 
command visited proved to be impossible for many large 
commands although it usually was possible in the smaller 
organizations, Whenever possible, informal structural analysis 
complemented the formal analysis, especially in the selection 
of billets for further interviews. 
c. Techniques Employed in Data-Gathering 

Collection of data against the organizational 
parameter was the most Straightforward of all. The data were 
available from several sources, publications as well as 
personnel, and were the easiest to verify. The variables 
within this parameter were collected by library and archival 
research, and by the techniques of questionnaire and interview. 
Samples of the data-gathering instruments used are found in 
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(1) Questionnaire, Many of the questions 
posed in the preliminary questionnaire dealt with organiza- 
tional data. The questionnaire which was sent out to the 
selected organizations and their billets of interest, served 
as the research's first contact with the population. It 
aimed primarily at the command's location, the billet itself 
enagwhiere it fell wathin the organization, and of course at 
the officer who occupied the billet. Questionnaire data 
supplied the values for variables 001 (command name), 

002 (billet sequence code), 003 (billet title), 016 (billet 
Ssubspeciality), and 083 (comments). Organizational data 
collected by the questionnaire also weighed in the decisions 
made later regarding billets to be interviewed during the 
on-site visits. 

(2) Interviews. The interviews conducted on-site, 
while not necessarily providing specific data for the 
organizational variables, were invaluable for the informal 
structural analysis attempted by the researchers. Through 
the interviews, the researchers often gained an understanding 
of the organization and how it related to the rest of the 
community. This information was very important to the project. 
Comments regarding organizational alterations, proposed or 
carried out, were recorded along with the other parameter 


data gathered in the interviews. 
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2. The Personal Parameter 

The personal (or biographical) data collected in this 
research was, from the beginning, to be kept at the minimum 
required to complete the analysis. Since most of the data- 
gathering techniques involved a degree of respondent partici- 
pation, it was felt that questions involving sensitive and 
unnecessary personal facts should be avoided. As a result, 
the variables within the personal parameter describe the 
individual only in light of his education, his organizational 
location, and the career path he has followed. 

a. Variables Within the Parameter 

(iS Nemes(VAROID)~ Self explanatory variable. 

(2) Billet Title (VARO03). The billet titles 
varied from command to command, and many biiliets with the 
same titles often had very different functions. 

(3) Rank (VARO11). One of the constraints 
imposed upon the research was the limit placed on rank. For 
reasons discussed elsewhere in this paper it was decided to 
limit queries to billets requiring ranks Lieutenant Commander 
and above, although this was later amended to include some 
junior officers where conditions warranted. 

(4) Age (VARO12). Self explanatory variable. 

(5) Designator (VARO13), Previous Designator 
(VARO14), and First Designator (VARO15). The designator is 
a numerical code assigned to officers by the Bureau of Naval 


Personnel. It reflects their warfare speciality (surface 
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warfare, aviation, intelligence, etc.). As an officer 
progresses through his career his gost eases usually changes 
at least once, reflecting advancement within a speciality, 
augmentation, and other changes. The three-variable 
designator history proved to be valuable to the research. 

(6) Subspecialty Code (VARO17). The sub- 
speciality code, another numerical code assigned by the 
Bureau of Naval Personnel, is granted to officers completing 
advanced education in any one of several fields. The 
subspecialty code, or "P-code" is usually a product of 
postgraduate education, and as noted in the Organizational 
Parameter section, can be required for specific billets. 

(7) Educational Level (VARO18). This was set 
up in the data base as a one-digit code reflecting the 
officer's educational achievement: 0 = less than a bachelor's 
level, 1 = bachelor's level, 2 = postgraduate studies, 

3 = VAR207 (below), 4 = master's level, and 5 = doctoral 
level studies. 

(8) Training Used in Present Billet (VARO19). 
This five-digit variable was coded to a number of sources of 
specialized training that the respondent may be drawing upon 
in his present billet. A complete list of the variable 
values is given below in the discussion of the Educational 
Parameter. 

(9) Defense Intelligence School Graduate (VAR207). 
In addition to the information contained in VAR019 above, the 


population was queried to locate all graduates of the DIS and 
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its precursor, the Naval Intelligence School, Anacostia, 
Maryland (NIS). 

(10) First Intelligence Billet (VARO20). This 
variable identified those officers occupying their first 
intelligence billet. 

(11) Years Experience (VARO21). This variable 
recorded the total number of years of intelligence experience 
the respondent had accumulated. 

(12) Months in this Billet (VARO22). To properly 
evaluate a respondent's comments and remarks, data concerning 
his time in the billet was recorded. 

b. Biographics Impact 

A measure of the flexibility of the research 
project presented itself when one of the respondents was 
transferred. Since follow-up Delphi instruments were individ- 
ually mailed to respondents, they followed those officers who 
had been transferred to other organizations. This not only 
gave the research more depth in the total number of billet 
cases available for file, but led to the idea of maintaining 
a listing of key officers in the community and their locations, 
with a periodic update feature incorporated. This listing was 
not meant to duplicate efforts underway at the Bureau of Naval 
Personnel, but rather to be integrated with the file of 
billets and thus add to the project's capability to provide 


a means for dynamic measure. 
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c. Techniques Employed in Data-Gathering 

The personal information required by the research 
was kept at a minimum in order to facilitate its collection. 
The researchers did not foresee building up a file of 
complete biographies but rather collecting just those 
variables which would prove to be statistically relevant for 
analysis. As in the case of the Organizational Parameter, 
the data collection techniques were to combine thoroughness 
with ease of completion. 

(1) Guestionnaire. Much of the personal data 
collected was gathered from the questionnaire sent out at the 
beginning cf the project. The personal variables appeared in 
logical sequence with the organizational variables, and only 


one questionnaire was returned with 2 stated objection to the 


> 


information requested. Questionnaire data supplied billet 
title (VARO0O3), name (VARO10), rank (VARO11), age (VARO12), 
designator history (VAR013 through VARO15), subspecialty 
code (VARO17), educational level (VAR018), training used 
(VARO19), intelligence billet experience (VARO20 through 
VARO22), DIS/NIS tours (VAR207), and finally, comments 
(VARO83). The personal variables requested on the question- 


naire integrated well with the organizational and educational 


variables and many served more than one parameter. 


‘che requested information was provided, however. 
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(2) Interview. Questionnaire data from those 
billets elected for on-site interviews were screened carefully 
during the selection process. Preliminary structural analysis 
of the parent organization was performed. The interviews then 
provided an effective device for checking and clarifying the 
background data gathered by the questionnaires. The inter- 
viewer used the preliminary statistics gained from the 
questionnaires' personal data to discuss those areas that seemed 
to be significant in the billet holders' careers. Designator 
histories and specialized training used in the billet were two 
examples of personal variables discussed and corrected in the 
Mmeer views, The Opportunity fer error checking and clarifica-— 
tion afforded by the interviews proved so valuable that it was 
decided to include ali the previously submitted questionnaire 
data (from all parameters) on successive Delphi iterations, to 
allow the entire population to review and update the files. 

3. The Functional Parameter 
a. The Modification of Task Analysis 

Although concepts of task analysis formed the core 
of this parameter's research methodology, they could not be 
applied too literally. Methodologies already in existence 
were not directly applicable because of security problems, lack 
of commonality of "tasks", and general ill-fitting methodolog- 
ical design. What was substituted was a modification of task 
analysis which might more aptly be called functional analysis. 


Where the former stresses a study of the task as a unit of 
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work, functional analysis focuses on functional outputs of 
analytical or logical processes. A description of the intelli- 
gence community in terms of its outputs seemed appropriate and 
more eaSily obtainable without the detail demanded by task 
analysis methodologies. Most of the variables against which 
data was collected within this parameter made up the community's 
Wentput list”. 
b. Variables Within the Parameter 

(1) Billet Title (VARO03). 

(2) Rank (VARO11). 

(3) Designator (VARO13). 

(4) Billet Subspecialty (VARO16). 

(5) Training Used in the Billet (VARO19). 

The functional description of the intelligence 
community was begun by submitting to the population, via a 
Delphi, a list of intelligence functions or outputs. Each 
respondent was asked to indicate by a percentage the amount 
of his work time which was spent on each of the applicable 
outputs. Outputs important to the billet but not appearing 
on the list were also solicited. The list of outputs as it 
was published in the first iteration of Delphi "A" was created 
by a group of intelligence specialists locally and included: 

(6) Administration of Intelligence Office (VARO25). 

Phis output variable refers to the mundane 

tasks required to operate and manage an office. Examples 


include the verification of clearances and the indoctrination 
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of personnel in the security aspects of intelligence work. 
This category provides little if any substantive intelligence 
information. 

(7) Briefs and Debriefs (VARO27). This variable 
represents the percentage of time spent in both the preparation 
and performance of prepared and extemporaneous briefings. The 
prepared briefs are those in which technical and analytical 
Specialists prepare written textual copy as an input for 
delivery by a professional briefer. Debriefs are somewhat akin 
to briefs except that they operate in the reverse direction. 

A debrief would normally not be a function of a stateside 
intelligence office. However, some debriefing may be carried 

on at the Washington level in working with defectors or in 
questioning dissident personnel, The majority of the debriefs 
of the intelligence officer would be conducted in the field in 
order to obtain data from an operational intelligence collection 
mission such as an aircraft surveillance of Soviet merchant 
shipping in the vicinity of the continental United States. 

(8) Budgets and Budgeting (VARO29). Budget 
estimates are required to support requests for funds to finance 
various aspects of the intelligence collection and reporting 
process. 

(9) Charts and Visual Aids (VARO31). The 
preparation of these instruments often requires close attention 


from officers responsible for them. 
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(10) Counterinteliigence Studies (VARO33). 


This output variable referred to the collection, codification, 
and dissemination of information concerning espionage, sub- 
version, and sabotage activities pertinent to naval functions. 

(11) Data Analysis (VARO35). Data which has - 
been collected by various means normally is of little use until 
after a process of scientific and intuitive compilation. This 
variable recorded the amount of time spent in making data 
useful for the next consumer. 

(12) Decisions and Recommendations (VAR037). 
This output variable referred to the amount of time the 
respondent spent in the decision-making process or in formu- 
lating recommendations for superiors. 

(13) Estimates (VARO39). The estimates function 
included the process of making predictions based on available 
laiee . 

(14) Intelligence Annexes to Operation Orders 
(VARO41). This output included the initial preparation of 
updating of the written intelligence Annex to Operation Orders 
being compiled or revised. The Annex often presents a general 
overview of the political, military, and economic aspects of 
a given operation. 

(15) Intelligence Collection Plans (VAR043). 
This variable recorded the time spent in advanced planning and 
the policy formulation used in operational intelligence 


collection missions. 
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(16) Intelligence Collection Tasking (VARO45). 
Tasking referred to the FiggenCnacaen GF guidance to intelli- 
gence collection groups. 
| (17) Intelligence Information Reports (VAR047). 
The most common information transmittal document in the intelli- 
gence business also required a great deal of time to complete. 
This variable recorded time spent both on the form itself and 
the background reading and research process that went into it. 

(18) Intelligence Studies (VARO49). These 
studies consume a large portion of time and are involved mostly 
with background review and research. 

(19) Interface With Automatic Data Processing and 
Telecommunications Equipments (VARO51). The intelligence 
Organizations addressed all had many connections with such 
equipments, and this variable recorded the amount of time spent 
in the ADP interface. 

(20) Order of Battle (OB) (VARO53). The variable 
recorded time spent in the preparation and update of various 
OB plots and publications. 

(21) Physical Security (VARO55). This function 
referred to the considerations of safeguarding classified 
material and equipment. 

(22) Tactical Plots (VARO57). These plots are 
the real-time situation plots Recssmeiig information, usually 
in visual form, for decision makers. The variable recorded 


the amount of time spent in their preparation and updates. 
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(23) ene: Outputs to be Added (VAR0Q63,066,071, 
074,079). These variables recorded the names and amounts of 
time of additional outputs added to the original list by the 
population. This list of variables enabled the researchers to 
modify the outputs for the second iteration of the Delphi 
(Delphi A2). 

(24) Non-Intelligence Output (VARO80). This 
variable recorded that amount of time devoted by intelligence 
officers to functions not directly related to their specialty. 

(25) Comments (VARO83). As with the other 
parameters, respondents utilized the comments variable to add 
additional information regarding the Functional Parameter. 

c. The Second Iteration of Delphi A (Delphi A2) 

As the responses to the first iteration of Delphi 
A were returned, it became apparent that the list of outputs 
had not included a few important items, and had included some 
that were no longer applicable. Using the additional outputs 
generated by the population responses, a new list of outputs 
was prepared to be submitted in the second iteration of Delphi 
A. The list included not only new outputs, but clarifications 
and some combinations of the old: 

(26) Administration of Intelligence Office (VAR187). 

(27) Resource/Organizational Management (VAR188). 

(28) Budgeting and Fiscal Planning (VAR189). 

(29) Decisions and Recommendations (VAR190). 

(CO) Steiseand Debriefs (VARI91) . 


(SI) Jutaisen (VAR192). 
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(32) Charts and Audio-Visual Aids (VAR193). 

(33) Counterintelligence Studies (VAR194). 

(34) Data Analysis (VAR195). 

(35) Estimates (VAR196). 

(36) Intelligence Annexes to OPORDS (VAR197). 

(37) Intelligence Collection Plans (VAR198). 

(38) Intelligence Collection Tasking (VAR199). 

(39) Intelligence Information Reports (VAR200). 

(40) Interface With ADP/Telecommunications (VYAR201). 

(41) Orders of Battle (VAR202). 

(42) Physical Security (VAR203). 

(43) Tactical Plots (VAR204). 

(44) Non-Intelligence Related Outputs (VAR205). 

(45> Counseling/Training (YVAR206). 

In addition to the new list, individuals who added 
outputs originally for which there were no new categories on 
the second list were asked to break them down into component 
outputs which did appear on the list. In the second iteration 
of Delphi A, a respondent who had added "Daily Intell Summary 
Messages" to the first list was asked to break that down into 
“Data Analysis" and "Estimates"; by this convention, and by 
providing the respondents with both their individual statistics 
and the population aggregate statistics recorded on the first 
iteration, it was Nened that a consensus of intelligence 


outputs could be reached. 
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d. Techniques Employed in Data-Gathering 

(1) Delphi A, The first Delphi instrument 
generated by this research dealt with functional outputs. 

The population was presented with a list of several intelligence- 
related functional outputs and a special category for non- 
intelligence related outputs and was asked to indicate the 
percentage of time each applicable output consumed in the 

normal work routine. These figures were then combined to 
reflect the population's average for each output applicable 

to the various billets and were resubmitted for a second 
iteration. The second iteration of Delphi A was constructed 
based on inputs received from the first iteration. The 
Statistics proved to be closer to consensus.” 

(2) Interviews. The billets selected for 
interviews were selected in accordance with the time allocations 
gained from the first iteration of Delphi A. The functional 
data provided by Delphi A aided the process of structural 
analysis and gave the interviewer a background upon which to 
base his questions. Unfortunately, the on-site interviews had 
to be carried out prior to the completion of Delphi A2. 

The interviews themselves served to clarify 
Functional Parameter data and allowed the interviewer, in many 
cases, to gain added insight into the billet and about the 
@eficer holding it. 


"See Presentation of Data. 
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4, The Educational Parameter 

The final parameter applied to this morphological 
analysis, the Educational Parameter, was the one containing 
the greatest degree of direct applicability. The importance 
rested on the project's usefulness as a tool for the Board . 
of Curriculum Review which was to study the Naval Intelligence 
Curriculum at the Naval Postgraduate School. If, in its 
description of the community, the project shed light on the 
present (and future) educational picture existing there, then 
it would prove invaluable to the board. The variables collected 
within this parameter were meant to deScribe the community's 
educational status, and tie it to the educational programs 
available within the service. 

a. Variables Within the Parameter 

(1) Age (VARO12). 

(2) Billet Subspecialty (VARO16). 

(3) Respondent Subspecialty (VARO17). 

(4) Educational Level (VARO18). 

(5) Comments (VARO83). Many of the comments 
received from the first questionnaire concerned the Educational 
Parameter. The respondents assumed that the questionnaire was 
Slanted toward education since the project originated at NPS. 

(6) DIS/NIS Graduate (VAR207). 

(eel reining Used in this Billet (VARO19). This 
variable was coded, in accordance with the key below, after 


the information was received from the questionnaires and 


61 









interviews. The variable, containing a five-digit field, 


allowed for many combinations of the codes: 


"1" = respondent has previous intelligence experience 

"2" = respondent has previous military experience (other 
than intelligence related experience) 

"3" = respondent has attended Defense Intelligence School 
or its predecessor, the Naval Intelligence School 

"4" = respondent has photographic interpretation or 
photographic experience 

"5" = respondent has attended intelligence training courses 
such as those given at the FITC's or at LOWRY AFB 

"6" = respondent has foreign language training, regardless 


of whether obtained through the military or other means 


"7" = respondent has ADP experience (either afloat or ashore) 
or training relating to ADP 


"8" = respondent has obtained professional military education 
(as opposed to civilian education). Examples are the 
various war and staff colleges. 


"9" = respondent has obtained professional training (as 
opposed to education) other than intelligence related 
training; examples are nuclear weapons/nuclear 
technology, FAAWTC's, destroyer school, submarine 
school, sensor management courses, etc.). 

b. Educational Subject Areas 

A major thrust of the interviews and the primary 
aim of Delphi B were to arrive at the degree of utilization 
throughout the community of several educational subject areas. 
With each applicable subject area discussed in the interviews 
(and later submitted on Delphi B to the entire population), 
the researchers attempted to arrive at estimates of: The level 
which the respondent actually used in his work, the level which 
he felt he needed in order to do things more easily or effi- 


ciently, and the level which he estimated to be necessary ten 


years from the present. There were four levels differentiated: 


62 





"1" = No need, or no contact with the subject area. 
"2" = Basic knowledge, an appreciation of the major concepts. 


"3" = Working knowledge, sufficiently familiar with the 
topic to discuss it with an expert, or arrange for 
work to be done within the area. 


"4" = Expert or theoretical knowledge. 
The educational subject areas were: 

(1) Mathematics. Including college algebra, 
calculus, probability and statistics, and advanced calculus. 

(2) Area Studies. Including the USSR, China, 
Mid-East, Europe, Latin America, and Africa. 

(3) Foreign Language. 

(4) Naval Science. Including underwater acoustics, 
sonar systems, communications, radar systems, optics, and laser 
systems. 

(5) Operations Analysis, 

(6) International Relations Theory. 

(7) National/Naval Budgeting Process. 

(8) Threat Assessment. 

(9) National Security/Intelligence Organization. 

(10) Red Forces. This subject area included 
Studies of naval, air, and ground forces belonging to "Red", 
and additionally, Strategic Rocket Troops and Merchant/Fishing/ 
Oceanographic forces. 

(11) Blue Forces. Including naval forces, both 
Strategic and general purpose, and forces of other services 


and of allies. 
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(12) ADP. Including system design, management, 
hardware ‘operation, software operation, and baSic interface. 

(ES ye Communication Skills. includinegs briering, 
Mitt ing, andserganization ef thought. 

(14) Management. Including collection system . 
management, PERT, management by objectives, personnel and 
financial management, and labor relations. 

c. Techniques Employed in the Data-~Gathering 

The Educational Parameter was the principal subject 
of Delphi B,: and shared equal time in the interviews with the 
Organizational Parameter. The primary aim of data-gathering 
for this parameter was to develop statistics, via the interviews, 
and to present them in Delphi form for population response. 

(1) Interviews. The on-site interviews gave the 
researchers excellent opportunities to diScuss education and 
what it meant to the officers interviewed. Each educational 
area listed above was discussed in terms of its application to 
the individual and his billet. Besides arriving at an estimate 
of the level used by the respondent, the interviewer also 
assessed the level that was needed, be it higher or lower than 
the one used. The Educational Parameter data gathered in the 
interviews was presented to the population in the second Delphi, 
Delphi B. 

(2) Delphi B. The educational Delphi was 
Submitted to the community following the return of Delphi A 


which was the functional area instrument. It was felt that an 
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introduction to the Delphi method should be made first, to 
insure that the more complex educational Delphi would be 
treated properly by the population. Delphi B presented the 
aggregate figures from the interview statistics and asked 
the respondents to rate, in light of the interviews, their 
own levels, used and needed, for each applicable subject 
area. As an added feature (demonstrating, incidentally, the 
flexibility of this instrument), the respondents were asked 
to project, based on trends they sensed within their spheres, 
the educational level for each subject that would be required 
in that billet ten years hence. As in the functional Delphi 
(Delphi A and A2), it waS recognized that not all respondents 
would be able to find applicability in all the subject areas. 
They were asked to respond to those that did apply. 
5. Area of Divergence 

As the problem statement was broken down into proposed 
parameter areas (organizational, personal, functional, and 
educational) and as these areas were in turn broken down into 
variables, about which information was to be collected (billet 
titles, ages, percentages of time per output, levels of 
mathematics used, etc.}), the data began to diverge. This 
process, of amassing data from a population which consisted 
initially of more than a thousand, was a task that could very 
easily have caused one to lose sight of the project's 
objectives. As each instrument was developed and implemented, 


as the data was compiled and filed, and as the research moved 
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from one stage to the next, divergence was partially 
compensated for by externally applied constraints. This 
divergence of data, of hundreds of unrelated variables, had 
to be better controlled. Otherwise things would begin to 
shift and soon the data's cart would be pulling the research 
project's horse. The answer to this dilemma, a set of 
controls, consisted of a series of constraints which was 


applied to the analysis by the researchers. 
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III. RESEARCH PROCEDURES: THE CONSTRAINTS 


A. CONSTRAINTS 

As the research progressed, two forms of constraint 
became obvious. The first form consisted of constraints 
applied to the project by the researchers. The second form 
consisted of constraints imposed upon the project by outside 
Pactors. 

The need for the first form of constraint became obvious 
as the problem statement was broken down into component 
parameters and the parameters were further broken into 
variables. In view of the number of organizations, the number 
of billets, and the number of people available to fill them, 
and considering the potential volume of detailed information 
which could be collected about each one, it soon became 
obvious that the project was in danger of geometric expansion. 
Severe constraints were necessary in order to keep the project 
within the limits of reality and practicality. 

The reality of the second form of constraint became 
obvious as planning for the research progressed. Because of 
the nature of intelligence and because of the environment in 
which it is produced, there was automatically established a 
rigid framework within which any research had to be conducted. 
This framework had a great impact on the instruments and on 


the actual techniques used. 
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The constraints fell into three general areas: 
Methodological and Procedural, Geographical, and Data 
Handling. The constraints served to arrest the endence 
toward geometric expansion, thereby limiting the size of 
the project and converging the research into a concise yet 
detailed description of the area being studied. 

1. Methodological and Procedural Constraints 

The methodology and procedures were affected by both 
types of constraint. Numbers and time affected the choice 
of instruments. Numbers and qualifications affected the 
selection of billets for study. Security considerations 
imposed rigid restrictions. The combination of all these 
factors necessitated a significant modification of the original 
formal task analysis procedures. 
a. Choice of Instruments 
More than 1000 billets were available for study. 
These billets covered a wide range of jobs and personalities. 
The researchers realized that intelligence officers, like 
most other active-duty personnel, usually have very limited 
amounts of time to devote to non-essential activities. They 
therefore knew that whatever instruments were selected for 
use would have to require a minimum amount cf the respondent's 
time. Otherwise there would be no hope of having a significant 
number of people participate in the project. 
Time, then, became an overriding consideration in 
planning the instruments which would be used. Complex 


instruments, requiring countless answers to long and detailed 
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lists of questions or time-consuming essays on many and 
varied Popes: might be suitable for a conscientious academic 
but would clearly be out of place for an overburdened military 
officer. As a result of the time considerations, every effort 
was made to select instruments which would take as little time 
as possible for completion. The goal was to use instruments 
which consumed no more than ten minutes at a time. 
b. Identification and Availability of Billets for Study 

The thrust of the research was toward individual 
billets within organizations which contribute to the naval 
intelligence effort rather than toward the organizations 
themselves. Therefore the billets which were selected for the 
project were those in which the individual performed an 
intelligence job as a primary duty. 

The billets to be addressed in the research were 
filled by naval officers, normally lieutenant commander (0-4) 
and above. Civilian personnel involved with naval intelligence 
were not included in the study. The decision to begin with 
officers 0-4 and above was made in recognition of the facts 
that a postgraduate education is normally within an officer's 
career pattern by that stage of his career, and that the 
majority of the more junior officers in intelligence have been 
trained for very specific skills. The junior billets, existing 
just below the level of middle management, are restricted 
primarily to specific intelligence skills such as photo 


interpretation and watch-standing; skills which must be 
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learned elsewhere and not in graduate school. The restriction 
on rank also of necessity eliminated many ship and squadron 
billets from the research, In most of those units though, 

the billet of Intelligence Officer exists only as a collateral 
duty. With the above constraints in mind, the project was 
initiated with a request to the Bureau of Naval Personnel for 
a computer print-out of all intelligence billets occupied by 
officers of the rank of 0-4 or higher. 

A careful screening of the resultant print-out 
was conducted. Billets which were primarily administrative 
in nature, even though filled by intelligence officers, were 
eliminated. These included such billets as Special Security 
Officer (SSO) and Special Activities Officer (SAO), whose 
primary dutieS were purely administrative, and were thus of 
little interest to the study. Other billets eliminated from 
the study were those in communications, supply, the defense 
attaché system, and certain sensitive billets. 

Left in the study were billets occupied by officers 
on their first intelligence tours. The decision to include 
them was made because so much of the community consists of 
personnel with little or no intelligence experience. Many of 
these billets will eventually be filled by graduates of the 
intelligence program at the Naval Postgraduate School or of 


Other postgraduate programs. 
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c. Security Considerations 

It was realized from the very beginning that a 
Study of any intelligence activity would be complicated by 
the fact that proper security would have to be provided for 
any classified material which was collected. The problem of 
security is particularly difficult in a purely academic 
environment such as the one at the Naval Postgraduate School. 

First of all, it was realized that there was no 
hope whatsoever of justifying student researcher access to 
any of the highly classified compartmented areas of naval or 
national intelligence. Even if access had been possible, 
problems of sanitization and handling would have made collection 
of the information most unwieldy. In addition, proper storage 
facilities were unavailable and the computcr center was in a 
completely insecure environment. An even more important 
consideration, from the academic standpoint, was the fact that 
a highly classified final product would be of no use to the 
very people for whom it was intended. 

For all these reasons, it was decided to keep all 
research on a completely unclassified level. It was felt that 
Such procedures would in no way detract from the validity or 
usefulness of the final product. In fact, an unclassified 
project could be much more versatile and comprehensive than a 
classified one. The functional parameter area was the most 
threatened by security restrictions and that was a contributing 
factor to the failure of task analysis as a methodology useful 


to the research. 
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With snes considerations in mind, the original 
listing of billets was studied for potential problem areas. 
Sensitive billets such as those in the defense attaché system 
and those involved in clandestine activity were eliminated 
from consideration. The numbers involved were so small that 
they were not felt to be Significant enough to affect the 
validity of the overall project. The billets remaining were 
all billets which could be discussed in unclassified terms 
with no problems of political or other overtones. The actual 
data which were collected were in Such general terms that 
there were no insurmountable problems of classification. 

The only real security problems encountered in 
the project occurred during the personal interview phase of 
research in Washington, Norfolk, and Hawaii. The researchers 
had final top secret clearances with access to Special 
Intelligence (S.1I.) information. Many of the people the 
interviewers wanted to talk to worked in spaces requiring 
compartmented intelligence clearances for access. Since most 
of the more Mey rilinbervious were conducted as the 
interviewee went about his daily routine, access to and 
meaningful interviews with many people were impossible. The 
two areas of most concern were at the Defense Intelligence 
Agency (DIA) and at the Naval Intelligence Support Center (NISC) 
where most of the key personnel work in spaces with access 
barred to the interviewers. As a result, it was not possible 


for the interviewers to talk to all of the people who had heen 
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previously selected as the best candidates for interviews. 
All too frequently it was necessary to talk to someone else 
who happened to be more convenient at the time. In addition 
to disrupting planned interview procedures, this constraint 
on access also meant the loss of participatory observation © 
aS a research tool. 

ad. Applicability of Task Analysis 

During the past thirty years task analysis has 
become an important tool in management. It has proven its 
usefulness in the human and material resources management for 
more efficient and effective production of both goods and 
services. However, task analysis hag not attracted much 
attention in the field of formal education. Although 
Bauueaticnal institutions deal with the management cf human 
and material resources and do produce both goods and services, 
they usually rely upon a more traditional approach. 

The traditional approach has been based upon 
intuitive feelings gained through: (1) past educational 
experiences, (2) conversations and meetings with professional 
personnel from industrial and research projects, performing 
consulting services, and actually working in industrial 
institutions. Although this approach may not have been 
inherently bad, it was limited by how current these experiences 
were, 

The Naval Postgraduate School is a unique institu- 


tion in that it not only must provide the educational background 





commensurate with traditional concepts, but it must also 
tailor different programs to the naval environment. Herein 
lie both a strength and a weakness of the above approach. 
Close and frequent affiliation with the naval environment is 
inherent in it. On the other hand, this association is not 
always related to day-to-day problems. The information that 
is received is more likely gained through a middleman within 
the shore establishment. Accuracy may therefore suffer. 

Task analysis can provide information directly 
from and about the operator without extensive personal con- 
tact. It does not provide the solutions. It can, however, 
provide information which can be drawn upon to bolster a 
sound decision-making process. It lends itself to computer- 
ization and manipulation to facilitate the examination of 
specific areas of study. Task analysis tends to reduce re- 
liance on subjectiveness.,. It places more emphasis on empiri- 
cal data. Task analysis then, from its description, appeared 
to be the perfect vehicle for the research project. | 

Conducting a formal task analysis proved to be 
too difficult in view of the constraints which were imposed 
upon the project by outside forces or by factors beyond the 
control of the researchers. Task analysis techniques are very 
involved and require a thorough understanding of a lengthy 
list of precise terms and procedures. In order to conduct 
the analysis, someone at the research site, either the par- 


ticipants or the researchers themselves, must have this 
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understanding. In the intelligence environment, this con- 
straint proved to be insurmountable. The terms and proce- 
dures were deemed too complex to try to convey to the partic- 
ipants in order to get a satisfactory response. (Some of 
these considerations have already been discussed above.) 
Geographical and fiscal factors as well as time (also dis- 
cussed elsewhere) precluded researcher visits to all of the 
sites. Even when a visit and an interview were possible, 
security considerations frequently made it impossible to go 
into sufficient detail to make a legitimate task analysis 
possible. The resulting data would probably have been suf- 
ficiently general to allow expression in an unclassified for- 
mat but the steps necessary to reach these distilled data 
required access to information for which the researchers were 
not eligible. A significant alteration to formal task analy- 
Sis procedures was necessary. As a result, a less precise, 
but nonetheless valid functional analysis was substituted, 
as outlined earlier during the discussion of the Functional 
Parameter, 
2. Geographical Constraints 

Since naval intelligence is a world-wide organization, 
and since the researchers were so few in number, and since 
research funds were so limited, sheer distances posed a 
dilemma. The members of the research team decided to try 
to simplify the options of the dilemma by dividing the vast 


geographical expanse into three response areas. Such a 
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division would still allow the gathering of sufficient detail 
while at the same time making it possible for team members to 
personally visit each area. The division decision was subjec- 
tive but was based on approximations of the numbers of billets 
physically located in each of the three areas and on the amount 
of travel money available. These three areas were: Washington, 
Norfolk, and Pearl Harbor. 
a. Washington, D. C. Area 

The Washington area was defined to consist of the 
District cf Columbia and those parts of Maryland and Northern 
Virginia which are usually considered to be in the Washington 
metropolitan sphere. The Washington area therefore contained 
such intelligence billets as those in the office of the Chief 
of Naval Operations, the Defense Intelligence Agency, and the 
Naval Intelligence Command with its field activities. These 
activities were physically located in such diverse locations 
as the Friendship Annex near Baltimore, Maryland to the north 
and the Hoffman Building Number I near Alexandria, Virginia, 
to the south. The billets or cases in the Washington area 
were assigned the numbers between 200 and 599. Three team 
members were responsible for gathering data and conducting 
interviews in this area. 

b. Norfolk, Virginia Area 

The Norfolk area was defined to contain not only 

the Norfolk metropolitan sphere but the remainder of the 


Eastern United States, the Atlantic Ocean, the Mediterranean 
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PeopeovuseutGeeedas well. The billets Greases in this area 
were assigned the numbers 600 and 799. One team member was 
responsible for gathering data in this area, and interviewing 
the incumbents of several billets in the Norfolk organizations. 

c. Pearl Harbor, Hawaii Area . 

The Pearl area was defined to contain all of the 
Pacific command as well as any continental United States 
(CONUS) billets west of the Rocky Mountains. These cases 
were assigned the numbers between 800 and 998. One team 
member was responsible for gathering data in this area, and 
conducting interviews in organizations located on Oahu, 
Hawaii. 
3. Data Handling Constraints 

Use of a computer for Stordye and manipulation of data 
opened up the possibility of collecting and handling a nearly 
unlimited amount of data. Without restrictions on storage 
and manipulation, the only reai limiting factor was the ability 
of the researchers to physically cope with the acquisition 
and the input and output of data. The primary data handling 
constraints fell into three main areas: restrictions on data 
capacity, the priorities placed upon the data base, and the 
capabilities of the data handling system. 

a. Data Capacity Restrictions 

As far ee: particular project was concerned, 

the computer imposed no limitations as to the quantity of 


data which could be stored and manipulated. The only 
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restrictions on the size of the project were limited to the 
abilities of the research team members to input, update, and 
Output data. Because of early decisions for the necessity 

to simplify the data gathering instruments, an extraordinary 
amount of time was required to design each form. A compromise 
position had to be found between excess complexity and excess 
brevity. This was necessary in order to ensure the collection 
of all essential data without the collection of anything 
superfluous. It was also necessary to arrange each form in 
such a manner that there would be minimal chance for confusion 
on the part of the person completing it. The extremes to 
which it was necessary to go to achieve these ends in form 
design were time-consuming and often expensive in terms of 
subsequent codina for machine processing. 

These considerations necessarily limited the 
variety of instruments which could be used and to some degree 
determined the number of cases which could be covered and the 
amount of information which could be collected about each 
case, 

(1) Selection of Billets to be Studied. Because 
of machine and programming capabilities and because of the 
procedures which were devised for handling the input of case 
information, more new cases could have been handled with 
relatively little additional effort on the part of the 
researchers. The only constraint in this area turned out to 


be the response provided to the initial set of questionnaires. 
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The number of people who sent the forms back was the number 
of cases used. 

(2) Selection of Outputs Applicable. Formation 
of a list of outputs proved to be difficult since every 
individual tended to think that his own billet was unique 
and without exact equivalent anywhere else. In order to have 
meaningful data and in order to be able to manipulate it, the 
researchers knew that their final list of outputs would have 
to be relatively short. Otherwise, general conclusions could 
not be drawn from it. It was here that the Delphi technique 
proved its worth since it gave the opportunity to go back to 
respondents and have them fit their earlier responses into 
the more recent categories. The final list of twenty outputs 
was on such a level that security problems were eliminated 
while at the same time enough detail was presented to allow 
for meaningful comparison and interpretation. 

b. Priorities of the Data Base 

Since the project was oriented primarily toward 
the individuals and their billets rather than coven the 
commands or the organizations themselves, it was felt that a 
significant amount of detail about each case was essential. 
This information had to be reduced to a form which could be 
expressed in terms common among all cases and reducible to 
punched cards. Once again, the machines which were used did 
not impose any restrictions. Instead, the restrictions 


depended on the ingenuity of the people involved in the design 
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of the questionnaires and coding forms. Emphasis had to be 
placed on the collection of meaningful data which would remain 
constant (not need updating) for the duration of the project. 
The information had to be expressed in terms so general that 
it would not be significantly altered by reorganizations or 
by movement from one command to another while at the same time 
being specific enough to have Significance. 
4. Area of Convergence 

To return for a moment to Zwicky's stages of morpho- 
logical analysis, the research at this point had progressed 
from a problem statement (describe the naval intelligence 
community) to the characterization of the parameters useful 
in that description (organizational, personal, functional, 
and educational) and their many component variables. Finally, 
the imposition of constraints, self-imposed as well as exter- 
nal, had to take place in order to prevent a geometric expan- 
Sion of increasingly less useful data. As the constraints 
were applied, the analysis began to take shape, to focus on 
what could be stated as a "description" of the community. It 
was within this area of convergence that the problem "solution" 
began to show itself. The next stage, and the final one in 
this or any morphological analysis, was the application of 
value criteria to the data file, for problem solving and 
other uses. That stage of the research is discussed elsewhere 


in the paper. 
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B. MORPHOLOGICAL ANALYSIS AND THE NAVAL INTELLIGENCE COMMUNITY 

aes Applicability 

The area of convergence discussed above is that 

Gescription of the community which can be Fornaio eed from the 
data base built during the morphological analysis process. 
‘In another section there is a discussion of the applications 
of value criteria. It suggests manners in which the data base 
may be used for further analysis and problem solving. The 
application of morphological analysis to the naval intelli- 
gence community has proven to be both a valid and a worthwhile 
project. Only an analysis methodology dependent on wide 
ranges of divergent data can successfully cope with such data. 
The task of describing, codifying, and monitoring a community 
of highly specialized military personnel scattered over wide 
ranges of geography is formidable at best and requires a 
methodology that flourishes on large quantities of divergent 
data. 


2. Problems Encountered and Adjustments 
to the Basic Methodology 


A thorough treatment of this topic can be found in 


the concluding section. 
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IV. ESTABLISHING THE COMPUTERIZED DATA BASE 


A. BACKGROUND 

i. introduction 

This section provides a simplified overview of 

documentation requirements and computerization procedures. 
These procedures and methods should not be restricted to this 
project. They are general enough to be applied, with minor 
modification, to many other areas of interest. A complete 
technical description of the programming and related procedures 
is included in Appendix E. A “Users Manual" is provided as 
Appendix C. 

2. Requirement for Computerization 

The magnitude of the administrative and research 

problems associated with documentation and the requirement to 
provide a capability for detailed statistical analysis of the 
resulting data forced the researchers to utilize the IBM 360/67 
computer facilities available at the Naval Postgraduate School. 
In general terms, the naval intelligence community was known 
to include more than one thousand naval officers. The decision 
to restrict the research to the upper and middle managerial 
levels (pay-grades 0-4 through 0-6) reduced the population 
total to approximately five hundred individuals, spread over 
the entire globe, from the Far East to the Mediterranean. 
The size of the administrative task of continued Bot veanondence 


with each member of the sample population was sufficient reason 
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for using a computer for the project. The vast quantity of 
wide-ranging data inherent in morphological analysis made 
the efficiency of a modern computer mandatory. 

3. Precepts Used in the Computerization Process 

Two basic precepts governed the computerization 

process: The human workload must be reduced to the absolute 
minimum, regardless of the effect on program execution time 
Or other computer resource consumption aspects. Secondly, 
to the greatest extent Bes suas, the project programming 
efforts must utilize "canned programs." The use of these 
pre-programmed packages allowed for a more widely usable and 
accessible data base and minimized the manpower required to 
program specialized data handling routines specifically for 
this project. As discussed kEclow, the intent of the second 
precept was not fully realized. To fulfill the first precept, 
tasking the computer with the administrative requirements of 
the project, it became necessary to develop a detailed and 
definitive information coding plan which would allow for an 


unrestricted data base flexibility for future data retrieval. 


B. THE OVERALL PLAN 
1. Project Phases 
The six phases of this project began with the planning 
phase in May, 1974. During this initial phase the require- 
ments for computerization, as discussed above, were pointed 
out and the overall research progression was established. 


The second phase of the research centered around the publication 
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of Delphi A from which initial biographical information and 
output data were collected. The problematic statement and 
the related parameters were formed during these phases of the 
morphological research and Delphi A collected the first 
parameter data to be computerized. These data were used in 
the execution of subsequent phases and were stored for future 
analysis. Phase three involved the on-site interviews and 
their related forms and data; phase four involved the second 
iteration of Delphi A, and phase five produced the educationally- 
directed Delphi B. Phase six, the final phase of the project, 
used the data base thus collected to combine the parameter data 
and provide useful information for problem solving and value 
criteria application. The computerization plan focused 
primarily on the construction cf the data 
files. 
2. Data Base Construction Sequence 
After each phase of the project had been completed and 
had produced additional information for insertion into the 
data base, several distinct steps were executed in sequence in 
order to insure a valid and retrievable data file. 
a. The Validation Step 
Each validation was as exhaustive as possible, 
within reasonable constraints, to insure that what came to be 
called the “clean" data base did in fact contain only that 
information desired for the project. Whenever possible the 


validation consisted of computerized reasonability tests on 
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the information. For example, a warning message would be 
generated if a variable such as “age" was noted to be outside 
a prescribed range of “reasonable" figures for the population. 
If programming was unable to perform adequate checks, visual 
verification was uSed. Where possible, the computer programs 
themselves corrected erroneous data fields, thus following 
the original precepts about the role of the machine in this 
project. If it was not possible for the programs to logically 
insert corrected information, the warning messages specifying 
trouble areas were produced. It was presumed that occasional 
reasonability tests would falsely signal invalid data due to 
the very tight restrictions imposed. In no caSe was a compu- 
ter-generated correction inserted for any data field unless 
Tiere waS Ho question about its propriety. 
Deeeer intingeot Ene Data Cards 

The next step consisted of the printing of the 
data base. Because of the large number of variables contained 
in the data base and because of the desire to ease the human — 
burden, each field in the data basSe was labelled an plain 
language in the printouts. 

c. Sequential Data File Preparation 

After data card validation and printing, the 
newly created data subsets were inserted into the data file. 
In most instances afc Step included only the merger, of 
card(s) or the card image(s) on disc, with preceding data 


file sets in the proper sequence. 
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d. Generation of the Statistical Package 
The final step in the data base generation was 
the input of the data base file to the statistical package 
program. As will be discussed later, the statistical program 
chosen for this purpose had the ability to retain its own file 
of input/output data images for use in follow-on analysis. 
Once this step was carried out the data was ready for 
transformation into meaningful information. 
3. Administrative Support 

In addition to the task of data base generation, the 
overall plan included use of the computer's high speed printer 
to produce any specialized printed output (such as forms and 
mailing labels) which reduced the administrative burden. It 
was felt that local printing facilities would suffice for the 
greater part of the communication needs between the research 
group and the population but in those cases where the printed 
material was to be specifically tailored and unique for each 
respondent, it was highly desirable to have the computer pro- 
duce the necessary forms. This capability held significant 
import in the planning of the variables which were included 
in the basic data base cards. The plan called for the compu- 
ter to generate messages requesting completion or clarification 
of several items of interest in the respondents' files, and 
each request had to be specifically tailored to the individual 
case (for examples of individually tailored output forms see 


Appendix B). 
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C. COMPUTER LANGUAGE AND PACKAGED PROGRAM COORDINATION 

1. Choice of the Primary Level Statistical Package 

There were numerous available statistical program 

packages from which to choose. The NPS Technical Note 
0211-22 by G.P. Learmonth provides a cursory review of the 
more important packages. From that collection, two were 
considered for this project: BMD or BIOMED, the biomedical 
Computer Program group, and SPSS, the Statistical Package 
for the Social Sciences. SPSS was selected for all of the 
statistical analyses associated with this project. The selec- 
tion was based on consideration of ease of use, data file 
retention capability, prior experience, numeric data printing 
ability, uncomplicated programming requirements, and the wide 
assortment of statistical routines applicable to the specific 
needs of the research. Program execution time and ancillary 
equipment requirements were not factors in the decision. 
SPSS is well documented in a text written by Nie, Bent, and 
Hea 

2. Secondary Level Administrative Support Languages 

One disadvantage of all the available statistical 

Packages was the inability to process alphanumeric data fields 


and to produce those specialized outputs required for 


1Norman H. Nie, Dale H. Bent, and C. Hadlai Hull, 
Statistical Package for the Social Sciences, New York: 


McGraw-Hill Book Company, 1970. 
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administrative purposes, This basic shortcoming led to the 
need for a supporting language which was capable of alpha- 
numeric string manipulation. Of those suitable and locally 
available assembly/compiler level languages, COBOL, ALGOL, 
FORTRAN, and PL1 were considered. The necessity for string 
manipulation capability reduced the list to ALGOL and PL1l. 
Prior experience with ALGOL weighted its choice as the secon- 
dary support language. Again, program execution time and 
ancillary equipment requirements did not play important parts 
in this decision. Stanford University ALGOL W of 16 January 
1972 was the version in use locally during this research. 
Two texts produced by Stanford University Computer Science 
personnel document their ALGOL W compiler up to an inter- 
mediate Lewelo 

The decision to use ALGOL W ultimately proved to be 
disadvantageous because of the lack of diversified input/ 
output control programming. The magnitude of this deficiency 
was not realized until after significant resources had been 
committed to the basic data definition module. Time con- 
Straints precluded reprogramming in the alternative PL1l 
language, so the decision was made to attempt, at execution 


time, an in-core linkage between FORTRAN input/output 


shee Sites, ALGOL W Reference Manual, STAN-CS-71-230, 
Stanford University: February 1972, p. 107-110.3. And Henry 
R. Bauer, Introduction to ALGOL W Programming, Stanford 
University: July, 1969, 
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Subroutines and ALGOL W main programs. This solution, which 
had never been documented at the NPS facility, proved to be 
feasible and operable. Documentation is contained in Appen- 
dix E, Fig. E-2. With the exception of this input/output 
deficiency ALGOL W proved to be a versatile and useful lan- 
guage. Only a minimum amount of FORTRAN programming was 
necessary in the input/output role. 

3. Tertiary Level Support Programs 

Statistical analysis was performed using the SPSS 
package and secondary level administrative support was pro- 
vided by the ALGOL/FORTRAN linked programs. These programs 
did not provide ready solutions to the required routine 
"housekeeping" chores such as placement of card files on 
disc. They were not readily adaptable to the printing of 
various data files. 

Standard IBM-produced utility programs were utilized 
for the reading and writing of data files and for the printing 
of unedited card images. For the printing of tailor-made 
outputs, it was discovered that a new printing program, which 
utilized the lower and upper case print capability of the 
"TN" print train for the Model 1403 printer, was available. 
This printing program, called Text Processing System (TPS), 
was tied together with the various secondary level ALGOL/ 
FORTRAN programs to produce pseudo-typewritten hardcopy. The 
Text Processing System was the communication link between 


each of the several hundred respondents and the research 
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group in those instances where personalized output was 
required. The available documentation for the TPS program 


is presented in Appendix C. 


D. COMPUTER STORAGE REQUIREMENTS AND SECURITY ASPECTS 
1. Data File Storage Facilities Used 

Initial planning indicated that approximately ten to 
twelve data cards would be generated per case. Each case 
would consist of the information pertaining to a single re- 
spondent. Had there been 100% participation, it was con- 
ceivable that up to 6000 data cards would have been needed 
to contain the data file. This number did not include the 
auxiliary files for such things as address labels and scratch 
files used between different phases in the project. Some 
files were quite lengthy, ranging upwards from 100,000 card 
images. The manager of the computer center operations group 
provided a dedicated Model 2311 disk storage file for the 
duration of the project. This disk file was numbered SYS003. 
It was agreed that only those files absolutely necessary for 
follow-on research would remain on a storage device. These 
few files were, however, to be transferred to tape storage, 
thereby releasing the dedicated SYS003 disk. At the time of 
closing out the working and utility files, those files which 
could possibly be needed in future regeneration of the data 
file were returned to punched card form for permanent 


historical retention. 
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Only one file remained on tape storage after the 
project was completed. That file, called the INTELL file, 
was the composite statistical package data file in SPSS 
format and included all of the variables accumulated during 
the span of data collection and analyses. It remained as 
completely "raw" data without having been recoded or trans- 
formed in any manner. 

2. Security Of The Data File 

Since perSonal data is contained on the INTELL file, 
discretion is required in use of the file. Throughout the 
data collection phases, a concerted effort was made to avoid 
classification. Even though the INTELL file is not classi- 
fied, it should be treated aS Sensitive information. Indis-— 
criminate use of the information contained therein would 
serve only to betray the enthusiastic support and response 
provided by the respondents. Non-attribution to source was 


a keyword throughout the entire project. 


E. SUMMARY OF COMPUTER RESOURCES CONSUMED 

TABLE 1 presents the accounting information for this 
project. This data reflects the total amount of CPU time 
consumed (in seconds), the number of jobs executed, the 
number of lines printed, and the number of program cards 
read. The breakdown between the administrative portion 
Cree., programmang, Printing, and file generation) versus 
the utilization portion (i.e., the statistical analysis) was 


imprecise. However, the total thesis project statistics are 
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exact and reflect the total of all accountable aspects of 
the research. 

Some interesting facts are obvious from the accounting 
information for October through December. The October data 
for administration of the data base indicates a very large 
number of jobs was executed. This was a result of the large 
number of small test programs which were written to opera- 
tionalize the ALGOL/FORTRAN linkage. As the problems were 
overcome, the number of jobs executed decreased significantly. 
Further, the number of lines printed and the number of cards 
read decreased throughout those months. The utilization of 
the disk storage facilities was primarily responsible for 
this decrease. As the problems were overcome, the majority 
of all programs and data were shifted to the data disk SYS003 
and recalled from there internally. This type of data and 
program transfer within the computer and its files was not 
included in the accounting information. The accounting 
information for December shows a definite decrease. This 
resulted from a computer shutdown from 19 December 1974 


Emrough 2 January 1975. 


F, RECOMMENDATIONS 

It should be apparent that better methods to approach the 
computerization process were available. But with the excep- 
tion of the input and output control problem associated with 
the ALGOL compiler, no change in methodology is recommended. 


Once the operator became accustomed to the awkward nature of 
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file control, the enhanced alphabetic string capability of 
ALGOL certainly proved advantageous. If one were to start 
from the beginning, however, strong consideration should be 


given to the PL1 language vice ALGOL. PL1 would not be so 


encumbered. 





V. PRESENTATION OF DESCRIPTIVE DATA 


A. INTRODUCTION 

This section provides an empirical description of the 
Naval Intelligence Community in terms of the data collected 
and explains the basic decisions made before the data base 
was constructed, the possible weaknesses inherent to the data 
as a result of these decisions, and the effectiveness of the 
measures taken to reduce the number of mechanical errors. 
The section Leen statistically evaluates the methodology used 


during the research. 


B. BASIC DECISIONS AND ASSUMPTIONS 

The initial decision to limit the research to the ranks 
of lieutenant commander through captain was previously 
discussed under Methodological and Procedural Constraints. 
This decision resulted in several considerations which should 
be discussed in some detail. 

The first consideration was encountered in the distribu- 
tion of the questionnaire. Although there was a listing of 
all intelligence related billets available, there was no way 
to match a specific billet with a specific person. Even if 
a billet was known to exist at a specified command there was 
no simple method for verifying that the incumbent was of the 


rank stated in the listing or that the billet was even filled. 
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The first questionnaire was therefore sent to the com- 
manding officer of every organization having an allowance of 
at least one lieutenant commander (or above) who filled an 
intelligence related billet. One hundred and nineteen 
commands fell into this category. Approximately 600 question- 
naires, including 100 extras, were distributed to the 119 
commands. It was requested that one questionnaire be given 
to every lieutenant commander, commander, or captain filling 
an intelligence related billet. Since no accountability was 
assigned to these forms it was impossible to determine the 
actual number of persons who actually received them. Since 
there were no evaluation methods, no inquiry was made 
concerning non-responses. A total of 325 of the original 
forms was returned for analysis. 

Questionnaires were received from 99 of the original 119 
commands and included a wide range of both operational and 
Support units. Since this response represented 83% of the 
polled commands, a thorough sampling appears to have been 
achieved. Furthermore, the wide geographical dispersion of 
the responses enhanced the probability that conditions unique 
to any one local area would not dominate the sample. 

A self-addressed return envelope was provided with each 
questionnaire to facilitate the ease of handling as well as 
to maintain the confidentiality of each return. Some 
commanding officers required that the completed questionnaires 
be returned to them for mailing; it was unfeasible to determine 


if this procedure had any Significant effect on the responses. 
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Although retaining the anonymity of the respondents is 
one of the primary advantages of the Delphi technique,- the 
forwarding of the questionnaires through the commanding 
officers was not considered a flagrant violation of Delphi 
procedures. In any case, all subsequent correspondence to 
individuals was marked for their attention and it was assumed 
that anonymity of responses was preserved for the remainder 
of the research. 

The next consideration concerned the use of self-evaluations. 
The potential for difficulties arising from respondent self- 
evaluation, particularly in the educational Delphi instruments, 
was recognized at the beginning of the project. There is, 
however, supportive evidence that subjective self-evaluation 
produces reliable data. A comparison cf the interview and 
the questionnaire data was performed and the results are 
presented later. 

The final consideration was whether or not to make the 
educational Delphi B a closed-end device. The purpose of the 
instrument was to provide a list of the educational areas 
relevant to naval intelligence and appropriate for graduate 
level academic pursuit. Time limitations precluded an open- 
ended approach. Extensive use of interview results was made 


in compiling the list which was finally used. The possibility 


1 oseph Paul Martino, Technological Forecasting for 
Decision Making, New York: American Elsevier Publishing 
Sermpany, Inc., 1972, p. 28. 


*Ipid., pp. 38,39. 
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of overlooking a valid area was recognized, but the list was 


believed to be sufficiently inclusive to provide useful data. 


C. MECHANICAL ERROR MINIMIZATION 

The term "mechanical error" was used in this paper to 
refer to those errors which were introduced during the process 
of coding and transposing raw data. Included within this 
definition are errors caused by personal bias as well as those 
caused by physical mistakes. The approaches used to minimize 
error in the coding phase are described next. 

Each research team member was assigned a geographic area 
of responsibility. As the completed forms were received from 
the respondents, they were distributed to the appropriate 
team member for a content and format check. Team meetings 
were held to define and discuss the items which required 
judgmental decisions on the part of the researchers. 
Standards, common and agreeable to all team members, were thus 
established. The forms were then coded for computer entry. 

By using this method all discrepancies and questions in data 
value assignment were satisfactorily resolved prior to key- 
punching for dai.a base entry. 

In the actual coding phase, heavy emphasis was placed on 
accuracy in transposing from unstructured raw data to the 
properly formatted data which could be manipulated by the 
computer. After judgmental discrepancies were resolved, the 


information was coded on the coding forms, the coding sheets 
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were converted into punched cards, and the punched cards were 
printed, and careful manual proof-reading and computerized 
reasonability tests were conducted. Errors were corrected 
and the data cards were reprinted, reread, and retested. 
After passing the second test, the data was inserted into 

the data base. Further details of the entire process are 
contained in Appendix E. It was assumed that two proof 
readings by two different people as well as the computerized 
reasonability tests were sufficient checks to ensure data 
accuracy. There was no attempt to check for, identify, or 


examine group bias. 


D. PARAMETER DATA DEFICIENCIES AND DESIGN MODIFICATION 
1. Organizational Parameter Data 

Organizational parameter data provided the foundation 
upon which detailed descriptions of organizations could be 
built. The primary requirement for this data was that it 
allow one to address each command by title, geographical 
location, billet structure, and any subspecialties. 

VAROOS (CONUS or Overseas Code) and VAROO6 (Country/ 
State Code) allowed any specific command to be selected 
according to geographical location. Difficulty arose in the 
data from the state of Virginia where the large numbers of 
billets in the Washington and Norfolk areas could not be 
distinguished. Recoding of the variables using unit identi- 
fication codes (VARO04) allowed each command to be addressed 


separately, however. 
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Billet sequence codes (VAR002) were originally designed 
to allow an alternative means for addressing each individual 
case. Many respondents would not or could not provide their 
billet sequence code, so this variable was unusable in the 
analysis. Since the case number was equally suitable for the 
‘purpose, the billet sequence code was not necessary. 

A problem that did affect the study occurred within 
VAROO3 (Billet Title). In many cases billet titles provided 
insight into the primary function of a billet, but a large 
number of billets had titles which gave little or no descrip- 
tion of the billet. A generic billet title such as 
"Intelligence Officer" is such an example. As a result, the 
potential of billet classification by common job titles could 
not be exploited. 

Mechanical and human errors in organizational parameter 
data were further minimized by submitting the actual coded 
version of the data to the respondents for verification. 

2. Personal Parameter Data 

The variables contained in the personal parameter data 
were designed to describe the individual billet holder as 
opposed to describing the billet itself. This data was 
therefore purely biographical and required few subjective 
judgments on the part of the respondents. This biographical 
information reflected the respondents' educational background, 


past experience, and previous training. 
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A combination of system checks, visual examination 
by the researchers, and feedback of data to the respondents 
was considered adequate to insure accuracy. 

3. Functional Parameter Data 

The third parameter consisted of a listing of naval 
intelligence outputs. In the interest of saving time, local 
intelligence specialists were polled for their opinions of 
community outputs. As a result of this survey, seventeen 
discrete areas were identified and were used as the basis for 
the first iteration of Delphi "A". The actual Delphi instru- 
Ment (Appendix B, Sample A) requested the percentage of time 
a respondent spent on each of the seventeen outputs. In 
addition, it requested a listing of any outputs which were 
not listed on the form. Of the 325 responses to the first 
questionnaire, 138 (42.5%) of the respondents added at least 
one output to the original list. A total of 247 additional 
Outputs was received but after collation of oneee outputs and 
after elimination of duplication, only three additional 
outputs were included in the final output listing. All out- 
puts were considered to be contained within the twenty listed 
ones. To assist the respondents in placing their own addi- 
tional outputs in the listed twenty, a computer routine was 
developed to prepare the second iteration of Delphi "A". 
This routine recommended alternative approaches for the 
respondent to consider. When the second iteration was returned, 


only one percent of the respondents indicated any difficulty 
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in making their revised outputs list conform to the expanded 
output categories. 

A valid criticism of the output variables is that 
they are not mutually exclusive although they are probably 
nearly exhaustive. The problem was recognized in the early 
Stages of the project, but no acceptable solution was 
apparent. Consequently, final analysis of the output data 
must be evaluated in light of this weakness. 

Another part of the first iteration was the attempt 
to determine whether each output on the list was considered 
by the respondent to be "valid" as an output for the naval 
intelligence community. Questionnaires were returned with 
requests for additional information, no response at all, and 
responses which indicated a clear misunderstanding of the 
question. As a consequence, the "validity" data was considered 
to be unusable and no attempt was made to readdress the 
question of the validity of the outputs. 

Improvement on the respondents! coding reliability 
was achieved through feedback of information derived from the 
first iteration of Delphi "A". This information and the 
respondent's appraisal of his outputs for the second iteration 
reaffirmed the value of the Delphi technique as a useful tool 
for the project. 

4, Educational Parameter Data 

Data for the educational parameter was also collected 

using a closed-end list of educational areas as previously 


discussed. 
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E. UNIVARIATE PARAMETER DATA ANALYSIS 
A ponoiece presentation of parameter data can be found 
in Appendix G. Highlights from each of the parameter areas 
can be found below. 
1. Presentation of Organizational Parameter Data 
a. Command Name — Of the 119 commands which 
received the original questionnaire, 99 (83.2%) had at least 
one respondent. 
b. CONUS/Overseas Code — Of the 325 respondents, 
220 (67.7% were located in the continental United States, 
24 (7.4%) were located in Europe, 66 (20.3%) were located in 
the Pacific, 4 (1.2%) were located in the Pacific Afloat, and 
11 (3.4%) were located in the Atlantic/Mediterranean Afloat. 
c. Country Code — Further geographic breakdown shows 
that responses came from ten states, the District of Columbia, 
eight foreign countries, four U. S. protectorates, and forces 
afloat in the Atlantic, Pacific, and Mediterranean. 
dad. Billet Subspecialty Code — Of the 319 military 
respondents, 126 (39.5%) reported that their billet descrip- 
tions called for a specific subspecialty. Of these, 91 (72.2%) 
specified the 7210 subspecialty code. 
2. Presentation of Personal Parameter Data 
a. Respondent's Rank — Of the 319 military respon- 
dents, 40 (12.3%) were captains, 97 (29.8%) were commanders, 
175 (53.8%) were lieutenant commanders, and 7 (2.2%) were 


lieutenants. 
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b. Respondent's Age — For each of these ranks, the 


mean age was as follows: 


captain 46.6 
commander 40.9 
lieutenant commander SiGn 
lieutenant 29.9 
Overall mean age 39.0 


c. Respondent's DeSignator — Of the 319 military 
respondents, 186 (58.3%) were 1630 intelligence specialists, 
41 (12.6%) were surface warfare specialists, 28 (8.8%) were 
air warfare specialists, and 20 (6.3%) were undersea warfare 
specialists. 

d. Respondent's Educational Level — Of the 325 
respondents, 21 (6.5%) had less than a bachelors degree, 

168 (51.7%) had a bachelors degree, 83 (25.5%) had a masters 
degree, and 3 (0.9%) had Ph.D.'s. 

e. Defense Intelligence/Naval Intelligence School 
Graduates — Of the 325 respondents, 139 (42.8%) had completed 
one of the Schools, 141 (43.4%) had not, and 45 (13.8%) did 
not respond. 

f. Years Previous Intelligence Experience — The mean 
number of years was 8.1 with a standard deviation of 6.0 years. 

3. Presentation of Functional Parameter Data 

Table 2 contains the final listing of intelligence 
community outputs. Column 1 lists the descriptive outputs. 
Column 2 presents the percentage of respondents who indicated 
more than zero percent of their time was spent working on the 
output. Column 3 presents the mean times spent in producing 


the output. 
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TABLE 2 


OUTPUT PERCENTAGE VARIABLES 


Variable Name 


Intelligence Office Administration 
Resource/Organization Management 
Budgeting and Fiscal Planning 
Decisions and Recommendations 
Briefs and Debriefs 

Liaison 

Charts and Audio~Visual Aids 
Counterintelligence Studies 

Data Analysis 

Estimates 

Intelligence Annexes to OPORDSs 
Intelligence Collection Plans 
Intelligence Collection Tasking 
Intelligence Information Reports 
Interface with ADP-Telecommunications 
Orders-of~Battle 

Physical Security 

Tactical Plots 


Counseling and Training 


Based on 276 cases 
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Percentage 
Respondents 
Reporting 
Output 
63.23 
62.0% 
43.8% 
vide 
63.5% 
65.4% 
Sr Sis 
TO Ore 
45.4% 
34.6% 
Ves5s 
24.1% 
2265 
27.8% 
41.4% 
24.7% 
43.8% 
18.2% 


50.0% 


Mean Percentage 
for Billets 
Reporting 
Output 


17.26 
T5a7% 





4, Presentation of Educational Parameter Data 

A detailed presentation of Sdrencione parameter data 
can be found in Tables II through VI in Appendix G. Since 
this data is cumbersome and Since pertinent facts are hard to 
discern among all the detail, a simplified graphical presenta- 
tion is approached in the following figures. 

For each of the three Delphi B groups ("Used", "Needed", 
and "Future" educational proficiency levels), each of the 
twelve major academic categories is depicted on a single bar 
graph. Each bar graph represents the cumulative relative 
frequencies of the levels of expertise required in each major 
subject area. For example, the mathematics bar is made up of 
the responses submitted for college algebra, beginning calculus, 
advanced calculus, and probability and statistics. The mathe- 
Iatics bar inFigure 1 therefore shows that more than 50% of 
the respondents stated that they did not uSe any of the 
Mathematical techniques listed, nearly 25% stated that they 
used a basic knowledge, less than 10% used a working knowledge, 
and less than 1% used an expert knowledge. 

A considerable degree of variance may exist between 
a particular subject's mean level of expertise and that of 
the group as a whole. The specific 42 academic subject areas 
which make up the twelve bar graphs are listed in Appendix B, 
Samples C and D, and in the following chapter. 

Such a graphical approach necessarily standardizes 


the twelve major academic groups since the data are presented 
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FIGURE 1 
PRESENTATION OF EDUCATIONAL DATA ("USED") 


Mathematics: . 


NNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNN | BBBBBBBB 


Foreign Language: 
NNNNNNNNNNNNANNNNNNNNNNNANNNNNNANNANNNNNNANNNNNNNN BBBB i: 
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Lj 
© 
ie) 
n 
ct 
Cc 
Qu 
© 
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| NNNNNNNNNNNNNNNNNNANNNNNNNNNNN | BBBBBBBBBBBBB | www | E| 


Operations Analysis: 

NNNNNNNNNNNNNNNNNNNNNNNN | BBBBBBBBBBBBBBBBBBBB | WWW | 
International Relations Theory: 

NNNNNNNNNNNNNNNNNNNN | BBBBBBBBBBBBBBBBBBB | WWWWWW | E 
Naval Science: 

NNNNNNNNNNNNNNNN | BBBBBBBBBBBBBBBBBBBBBBBB | WWWWWW |E 
Natitonal Security Aiftairs: 

NNN | BBBBBBBBBBBBBBBBBBBB | WWWWWWWWWWWWWWWWHW | EEE 
povlet Forces: 

NNNNNNNNNNN | BBBBBBBBBBBEBBBBBBBB | WWWWWWWWWWWW | EEE 
Blue Forces: 

NNNNN | BBBBBBBBBBBBBBBBBBBBBBBBBBBB_ | _WWWHWWWWWWWWW 
Automatic Data Processing: 

NNNNNNNNNNNNNNNNNNNNNN | BBBBBBBBBBBBBBBBBBBBB 
Management: 

NNNNNNNNNNNNNNNN | BBBBBBBBBBBBBBBBBB | WWWWYIWWWW 


Communication Skills: 


N BBBB WWWWWWWWWWWWWWWWWWW WWW WWW BEEBEGEEEEEEEEEEEEE 


| 


| 





75% 
LOC t-——— 


oe oe pa 
oO wn ms 
N Ve) 
"N" = Not Used; “B" = Basic; "W" = Working; "E" = Expert 
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FIGURE 2 
PRESENTATION OF EDUCATIONAL DATA ("NEED") 


Mathematics: 


NNNNNNNNNNNANNANANNNANINNANNAN INA BBBBBBBBBB WWWW 
Foreign Language: 
NNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNN BBBBBBBBB WWWWW 
Area Studies: 
NNNNNNNNNNNNNNNNNNNNNNNNNN BBBBBBBBBBBBB WWWWWWW TE 
Operations Analysis: 
NNNNNNNNNNNN BBBBBBBBBBBBBBBBBBBBBBBBB WWWWWWWWWW TE 
International Relations Theory: 
NNNNNNNNNNNNNN BBBBBBBBBBBBBBBBBBBB WWWWWYIWWWWW | OE 
'Naval Science: 
NNNNNNNNNNNN BBBBBBBBBBBBBBBBBBBBB WWWWWWWWWWWWW E 
National Security Affairs: — 
rN BBBBBBBBBBBBBBB WWWWWWWWW WWW WWW AWWW EBEEEEE 
Soviet Forces: 
NNNNNNNNNNNNNNNNN BBBBBBBBBBBBB WWWWWWWW WWW EE 
Blue Forces: 
NNN BBBBBBBBBEBBBBBBBBBBB WWWWWWWWWWWWWWWWWW EE 


Automatic Data Processing: 


[NINN | BBBBBBBBBBBBBEBBEB | WWWWWIW WWW [e | 
NNNNNNN BBBBBBBBBBBBBBBBBBBB WWYIWWWWWW AW WW GE 


ee 
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Communication Skills: 








| BB WWWWWWWWIWW WW WWW WW EEEEEPEEEEEBEEEEEEEEREEEE 






0% 
25% 
50% 
75% 
Boos —— 


"N" = Not Needed; "B" = Basic; "W" = Working; "E" = Expert 
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FIGURE 3 
PRESENTATION OF EDUCATIONAL DATA (“FUTURE") 


Mathematics: 


NNNNNNNNNNNNNNNNNNNNNNNNNNNNNN BBBBBBBBBBB WWWWWW | E 
Foreign Language: 

NNNNNNNNNNNANNNNNANNNNNNNNNNNNNNNNN BBBBBBB WWWWWWWW OTE 
Area Studies: 

NNNNANNNNNNNNNNNNNNNNNNNN BBBBBBBBBBBBB WWWWWWWWW . 


Operations Analysis: 


NNNNNNNNNNN BBBBBBBBBBBBBBBBB WWWWWWWWWWWWWWWW fo 


a 


International Relations Theory: 
NNNNNNNNNNNNN BBBBBBBBBBBBBBB WWWWWWWWWWWWWWW EEE 
Naval Science: 


NNNNNNNNNNN BBBBBBBBBBBBBBBB WWWWWWWWWWWWWWWW 


icity 2 
Wie SLT 


} 
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WACLONGsL o Bl sie S 5 


BBBBBBBBBBB WWWWWWWWWWWWW WWW WWW EEEEBBREEEE 


2 


Soviet Forces: 
NNNNNNNN BBBBBBBBBBBBBBB WWWWWWWWWWWWWWWW EEEEE 


Blue Forces: 
NNN BBBBBBBBBBBBBBBBBB WWWWWWWWWWWWWWWWWWw EEEEE 


Automatic Data Processing: 


NNNNNNNNNNN {| BBBBBBBBBBBBBBBB WWWWWWWWWWW WWW EE 


Management: 


NNNNNNNNNNN BBBBBBBBBBBBB WWWWWWWWWWWWWWWW | EEEEEEE 


Communication Skills: 


LB] WWWWWWWWWWWWWWWWWWWW 


EEEEEEEEEEEEEEEEEEEEEEEEEEEEE 









03% 
25% 
503% 
75% 
1003 ——— 


"N" = Not Needed; "B" = Basic; "W" = Working; "E" = Expert 
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in percentiles. Consequently, comparisons cannot be made 
between individual bar graphs. One cannot conclude therefore, 
Bast the foreign language requirements and the national 
security affairs sequence requirements are equally weighted. 
Later and more sophisticated analysis and scaling techniques 
will provide this ability to rank and to weight individual 
educational areas and to make normative conclusions about 


the data. 


F, METHODOLOGICAL EVALUATION 

1. Background 

Before proceeding to other analyses it is necessary 

to explore (from a statistical viewpoint) the aggregate 
effectiveness and characteristics of the methodology. 
Sackman” presents a hyper-critical analysis of the Delphi 
technique. After reviewing approximately 150 Delphi studies, 
lee states: 

If Delphi is to be treated seriously as a ; 

professional technique, it must be judged by 


basic, minimum standards applicable to all 
empirical social science. 


35 .S.A.F. Project Rand, Report R-1283-PR, Delphi 
Assessment: Expert Opinion, Forecasting, and Group Process, 


by H. Sackman, Santa Monica, California: The RAND Corporation, 
April 1974. 


OS SEa A we TL, 
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Sackman comments that he: 


‘ . has never seen the full three-dimensional 
matrix of items versus panelists versus rounds 
analyzed by a common statistical vehicle, such 
aS analysis of variance, to test for main and 
interaction effects. Nor are items compared 

for homogeneity of variance, linearity, and 

type of empirical frequency distributions for 
applying such tests. With small samples, inter- 
quartile Delphi graphs are no substitute for 
rigorous statistical testing of individual items 
and item subsets. This is not a pedantic frill — 
differential statistical reliability requires 


differential interpretation of findings. 


The following discussion empirically analyzes the more 


important facets of the resulting data base by using conven- 


tional hypothesis testing approaches. Six hypotheses were 


used in this process: 


Hypothesis A: 


Hypothesis 


Hypothesis 


Hypothesis 


Hypothesis 


Hypothesis 


There was a decrease in the variance of data 
acquired in the intelligence outputs Delphi A2 
relative to the data obtained from the 
Original intelligence outputs (Delphi A 

[EleESt Gteraticen|]|). 


There waS a decrease in the variance of data 
acquired in the educational "levels used" 
(Delphi, B) relative to the interview data. 


There was a decrease in the variance of data 
acquired in the educational "levels needed" 
(Delphi B) relative to the interview data. 


There is no difference in the intelligence 
outputs as reported in the first iteration 
data versus those reported in Delphi A2. 


There is no difference in the educational 
"levels used" as reported in the interview 
data versus those reported in Delphi B. 


There is no difference in the educational 
Mlewe seme sded sas reported in the interview 
data versus those reported in Delphi B. 





5 


Ibid., p. 14. 
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Each hypothesis was statistically tested and either 
accepted or rejected. "The probability of committing a type I 
error, which is denoted by a, is called the significance level 


of the oe 


A type I error results when an alternate 
hypothesis is accepted when the null hypothesis is, in fact, 
true. The a = 0.05 significance level was chosen for the 
cutoff point for hypothesis acceptance. 
2. Comments on the Statistical Analysis 
a. The Statistical Problem 

Finding an appropriate statistical analysis 
computer package became an almost insurmountable task. The 
SPSS programs were Suitable for the analysis which was per- 
formed early on, but when the time came to examine Hypotheses 
A, B, and C, it became obvious that the only applicable test 
was a multivariate analysis of variance test (MANOVA). No 
such preprogrammed capability existed at the Naval Postgraduate 
School computer facility, SPSS and BIOMED notwithstanding. A 
library search produced numerous texts at a theoretical level, 
but only ae! was found which developed a computerized solu- 
tion. This text contained a "cookbook" approach with program 
listings for several of the higher level statistical 


techniques. 


paul G. Hoel and Raymond J. Jessen, Basic Statistics 
for Business and Economics, New York: John Wiley and Sons, 
mre, 1971, p,. £97. 


TWwilliam W. Cooley and Paul R. Lohnes, Multivariate Data 
Analysis, New York: John Wiley and Sons, Inc., 1971, 
Chapter 8. 
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The programs were written in FORTRAN. The 
Cooley-Lohnes MANOVA program was modified to make it opera- 
tional on the Naval Postgraduate School IBM 360/67 computer. 
Modifications included using International Mathematical 
Subroutine Library (IMSL) double-precision matrix inversion 
and determinant calculation subroutines, cosmetic input/output 
changes, and the use of IMSL subroutines for the calculation 
of F-distribution values. No attenpt was made to integrate 
the double-precision array declarations; rather, the single- 
precision data arrays in the Cooley-Lohnes program were 
transferred to “REAL*8" dimensioned arrays and it was these 
arrays that were passed to the IMSL subroutines. These double- 
precision calculations were necessitated by some matrices 
being cloSe to Singularity and their Geterminants being very 


ay i Upon exiting from 


small numbers (on the order of 10 
IMSL subroutines, the results were usually truncated to 
Single-precision. A copy of one such calculation is contained 
in Appendix F Sample R. 
b. Variance Analysis 

Variable-by-variable variance analysis provided 
an indicator of dispersion characteristics. individual 
F-ratio tests would have been the only means of addressing 
variance analysis had the MANOVA program not been made opera- 
tional in time to be of use. The F-test is a comparison of 


two variance eStimates resulting in a ratio between the two 


variances. If the sample variances are equal, then the 


eae) 


F-ratio equals 1.0, and it is this ratio which provides for 
a measure of the probability that ene two Samples were drawn 
from the same population. On the multivariate level, the 
MANOVA technique considers all variables at one time and 
provides one Feratio for the composite of the sample groups. 
The results of these variance analyses is given in sections 
on Hypotheses A, B, and C below. 
c. Population Means Analysis 

Similar to the variance analysis approach, variable- 
by-variable Student's t-tests were made. The Student's t-test 
allows one to determine the probability that both sample means 
could have been drawn from the same population. Although not 
Capable of testing hypotheses directly, the tests do provide 
a preliminary review of pairwise variable relationships. 
Centroidal equality [the multivariate extension of equal 
sample means] was then approached in Hypotheses D, E, and F. 

While waiting for the MANOVA program to be opera- 
tionalized, an interim approach to hypothesis testing was 
taken. This approach used the "DISCRIMINANT" routine in the 
SPSS package. The basic principle of this approach was to 
take two groups of data fe.g., the interview data versus 
Delphi B data], develop a regression equation for each group, 
and utilize the resulting F-statistics to determine if a 
Significant aifference in centroids existed. The F-statistics 
resulting from these tests are a multivariate extension of 


Fisher's t-statistic used in testing hypotheses about 
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population means. The original multivariate relationship 
was developed for two groups by Hotelling in 1931 and is 
commonly known as Hotelling's T*-Statistic. After being 
operationalized, the same MANOVA program used in testing 
variance related hypotheses provided meaningful F-statistics 
for testing centroidal equality hypotheses. The resulting 
single F-statistic is similar to the multivariate extension 
of Fisher's t-statistic used in the DISCRIMINANT analysis. 
The results of all of the means and centroids equality 
analyses is given in the sections on Hypotheses D, E, and 
F below. 

d. The Power of the MANOVA Tests 


On the theoretical side, Cooley and Lohnes state: 


» . « these multivariate tests [MANOVA] are quite 
powerful, so research on large samples is quite 
likely to lead to a rejection of H; [the hypothesis 
that the populations have a common dispersion] with 
some consequent embarrassment to a MANOVA theory 
for the data. However, .. .a finding about group 
dispersions may have a great deal of value in its 
own right. 


Since the analysis performed in this project was made on 

large samples, it was no surprise that the null hypothesis 
for Hypotheses A, B, and C were rejected in all three cases 
with F-ratios of 3.40, 1.83, and 2.13, respectively. Each 


hypothesis is discussed separately below. 
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3. Hypothesis A Test Results 
The first hypothesis to be tested concerns instrument 


dispersions relating to intelligence outputs data: 


Hypothesis A: There was a decrease in the variance of data 
acquired in the intelligence outputs Delphi -A2 
relative to the data obtained from the 
Original intelligence outputs (Delphi A [first 
iteration]). 


Looking first at a variable-by-variable F-test, 
Table 3 contains the intelligence outputs and their individual 
variances. A two-tailed test was chosen and rejection zone 
established at the less than/equal to 0.975 and the greater 
than/equal to 0.025 levels. This is the usual 0.05 signifi- 
cance level with half [0.025] the area being split into each 
tail of the distribution. For the output data, the F~values 


corresponding to the 0.975/0.025 significance levels and for 


Vy 301 degrees of freedom in the queStionnaire data and 
Ve = 274 degrees of freedom in Delphi A data were 0.79 and 
1.26, respectively. Of the 16 intelligence output variables, 
seven [44%] indicated reduced variance, seven [44%] indicated 
no significant change, and only two variables [12%] showed 
increased varicence. 

The MANOVA calculations resulted in an F-ratio of 
3.40 with v,; = 136 [numerator degrees of freedom] and 
V2 = 1,036,604 [denominator degrees of freedom]. No precice 


tabular F-values were available or could be calculated 


locally. The approximate F-value at the 0.05 significance 
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level is 1.22. This meant that there is a statistically 
significant difference in group dispersions, 

Given that there is a difference in group dispersions 
[the MANOVA test], one must decide if the difference is due 
to an increase or to a decrease in variances. Because only 
two variables had an increased variance in the side-by-side 
variance comparisons as opposed to Seven with decreased 
variance and seven with no change in variance, Hypothesis A 
was accepted. There was a decrease in the variance of data 
acquired in the intelligence outputs Delphi A2 relative to 
the data contained in the original intelligence outputs 
Delphi A [first iteration]. 

4. Hypothesis B Test Results 
Mie Secore hypSsthesics wes aporcached in a manner 


Similar to Hypothesis A. This next hypothesis stated: 


Hypothesis B: There was a decrease in the variance of data 
acquired in the educational "levels used" 
Delphi B relative to the interview data. 


Variable-by-variable F-tests results are exhibited in Table 4. 
The two-tailed F-ratio 0.975/0.025 significance levels 
rejection zone was established as less than/equal to 0.73 and 
greater than/equal to 1.37, respectively; v,; = 102 [interview 
data degrees of freedom] and v2 = 258 [Delphi B data degrees 
of freedom]. Table 4 data shows nine variables [21%] had 
decreased variance, 32 variables [76%] showed no change in 
variance, and only one variable [2%] indicated an increase 


in variance. 
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MANOVA calculations resulted in an F-ratio of 1.83 
with vi = 903 [interview data degrees of freedom] and 
V2 = 124,342 [Delphi B data degrees of freedom]. The approxi- 
mate F-ratio tabular value [no precise values were available 
or could be calculated locally] is 1.05 at the 0.05 signifi- 
cance level. This test indicated a statistically significant 
dispersion difference existed. 

Since there was a dispersion difference and the 
Side-by-side variance analysis data from Table 4 indicated 
only one variable had increased its variance as opposed to 
seven variables decreasing and seven variables with no change 
in variance, one must conclude that Hypothesis B is true. 
There was a decrease in the variance of data acquired in the 
educational "levels used" [Delphi B] relative to the interview 
aca . 

5. Hypothesis C Test Results 


The last hypothesis concerning group dispersions was: 


Hypothesis C: There was a decrease in the variance of data 
acquired in the educational "levels needed" 
[Delphi B] relative to the interview data. 


Side-by-side F-tests were conducted. The two-tailed F-ratio 
0.975/0.025 rejectior. zone was the same as for Hypothesis B, 
i.e., less than/equal to 0.73 and greater than/equal to 1.37. 
The degrees of freedom were the Same: v1 = 102 andv2= 258. 
The results of these tests are shown in Table 5. Thirty-two 
variables [76%] showed decreased variance, ten variables [24%] 
showed no change in variance, and no variables indicated an 


increased variance. 
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MANOVA test calculations resulted in an F-ratio of 
2.13 with v; = 903 [interview data degrees of freedom] and 
V2 = 124,509 [Delphi B data degrees of freedom]. Again with 
no precise tabular F-value available, the approximate F-value 
is 1.05 at the 0.05 significance level. This test means 
there is a statistically significant difference in group 
Gispersions. 

Again given that there is a difference in group 
dispersions [from the MANOVA test], one must decide if the 
difference is due to an increaSe or a decrease in variances. 
Because no variables indicated an increased variance and the 
remainder either decreased or had no variance change in the 
side-by-side F-ratio tests, Hypothesis C must be accepted. 
There was a decrease in the variance of data acquired in the 
educational "levels needed" Delphi B relative to the interview 
data. 

6. Hypothesis D Test Results 
The first hypothesis which tested centroidal equality, 


i.e., the equality of means in a multivariate sense, was: 


Hypothesis D: There is no difference in the intelligence 
outputs aS reported in the first iteration 
data versus those reported in Delphi A2. 


The results of the pairwise Student's t-tests are listed in 
Table 6. Of the 16 intelligence outputs listed, three [18.7%] 


have statistically different means at the 0.05 level. 
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Factor DISCRIMINANT analysis computed an F-ratio of 
1.65 with-v:i = 14 [numerator degrees of freedom] and v2 = 568 
{denominator degrees of freedom]. The table value for the 
F-statistic at the 0.05 significance level is 1.71, thereby 
indicating no statistically significant difference in group. 
centroids. The MANOVA test produced an F-value of 1.48 with 
V1; = 16 and v2 = 568. This test also indicated there was no 
Statistically significant difference in group centroids since 
the F-table value is 1.66. 

Hence, based on both DISCRIMINANT and MANOVA centroidal 
tests, Hypothesis D was accepted. There is no difference in 
intelligence outputs as reported in the first iteration data 
versus those outputs reported in Delphi A2. 

7. Hypothesis E Test Results 

Following a scheme similar to the test for Hypothesis 

D, the used educational proficiency levels hypothesis was 


tested: 


Hypothesis E: There is no difference in the educational 
"levels used" as reported in the interview 
data versus those reported in Delphi B. 


The results of the pairwise Student's t-tests are presented 
in Table 7. Twenty-three of the 42 used educational 
proficiency levels [54.7%] have statistically significant 


differences in their means at the 0.05 level. 


126 





00°T UOTIeZTUeHIQ souSHTTTSeIUuL ¥ AZTANoes TeuoTIeN  TSZUVA 60TUWA 






*00°0 ZUSTISSeSSY FON pue ZeSTUL SLZUVA 8OTUVA 
¥00°0 suaysks UoTROSTION OLZUWA 90TYWA 
*00°0 si9sey LOTUVA GOTUWA 
*00°0 ‘sot3do VITUVA VOTUWA 
*70°0 sueqzshs zepey T9ZUWA EOTUVA 
*S0°0 sus zsAs uotzeoTuNnuMOD 8SZUVA ZOTUVA 
*00°0 suszsAg 7eUuoS GSZUWA TOTYWA 
*T0°O SOTisnody Teyemtepun CSZUVA OOTYWA 
*70°0 ATOsyL suot}zeToy Teuot}eursjuy 67ZUWA 650UVA 
Lo. 0 stsATeuy suotzeizsdo QVZUVA 860UVA 
90°0 SeTpNyS Peay ueoTASY EVZUVA L60UVA 
68°0 sotpni.g esrzy ueoTrSeuly uT eT OVZUVA 960UVA 
rT" O setpnis eozy uesdoing LE TAWA S60UWA 
T6°0 SOTpnys eoety Seq STPPTIW VETUWA v60UWA 
*Z0°0 SoTpnis esrzy euTyoD TEZUWA €60UVA 
vzZ°0 setpnis eezy ussn STCUVA Z60UWA 
60°0 ebenbfueyT ubterz0g GZCUWA T60UVA 
¥00°0 SOTIETIEIS Due ATT Tqeqorzg 7CCUWA 680UVA 
O€°0 sn[nNoTeD) poeoueapy 6TZUWA O60UVA 
ST°O sn~[note) S5utuutbeg OTZUWA 88OUVA 
6S°0 eaqebty ebetToo ETZUVA L80UWA 
4TLTTqeqoirg SUPN oTqQeTzea TYdT ed-mMetAreRur 
3s53-3 >STSQUNN STQetszaer 


suevoWw TeAST Teuotzeonp” ,agsn, Jo s3sei-3 s,j}uepnjAs 
“L aTavhL 


27 





“[S0°0 = 0] TeAeT FFORND ueyR ssoT seTITTTGeqorzd-} s,jZuepnjs sozPeoTputT » 





*+00°0 aySnouL Fo uotTZeztuebsz0 TVEUvA O7TUVA 
x00°0 HuTITIM SEEUVA GTTUVA 
*00°0 hutjyetig GECUVA VCTUWA 
08°0 suotzeTey roqey ZEEUVA ZETUVA 
ceo ssso0ig AzeVehpng TeAeN/TeuotIeN 6ZEUWA LOTUWA 
0S°0 quewsbeuew TeToueutd 9ZEUWA TETUVA 
¥00°0 quowsbeuew Teuuosieg €ZEUVA O€TUVA 
+00°0 seat zoelqg Aq Jusousheuey OZEUVA 67TUVA 
ZO suotj}ersdg edefsrAsRUL OTseq ddv LTEUvA ECTTUVA 
6T°0 H5utumerborg pue srzeMzygos dav PICUvA ZCTUVA 
*£0°0O suotzersdg eremprzeH ddv TTEUdvA TZTUVA 
LSs°0 quowsbeuew/ubtseq weysdAs dav 80EUVA OZTUWA 
*00°0O AATTTqedeDd PeTITW SOCUVA 6TTUVA 
¥00°0 S8070G Te@APN-UON °S°A ZOLUWA STTUVA 
¥00°0 sooz0g TeAeN °S°A 66CUVA LTUTUWA 
*x00°0O OTYderbouesd0/ysta/JuUeYyoOASW YOTAOS 967UVA GTTUVA 
9T°O sdooiZ 7exOoY OTboeReIr3g YoOTAOS E6TUVA DITUVA 
GT°O Sed1I0q PUuNnOID YeTAOS O67UWA ZTTUWA 
*T0°0 S009 ATy JOTAOS L87UVA TTTUVA 
¥00°0 AACN YOTAOS V8CUVA OTTUVA 
~ AqtTtqeqoig~—~—~—C~——“—..C.CCCWOC«‘é‘éOOWWNY SOT QwTAeA TydTSd-MaTAIOAUL 
3#S93-3 7STOCUNN STGeTrAeA 


Sues TeASeT TeuotzeonpY, ,dgSn, Fo sso 3-3 s,7ZuepNyAs 
(ponut3uod) L Taw 


128 






The DISCRIMINANT analysis routine computed an F-value 
of 8.44 with v; = 38 and v2 = 322. This indicates a signifi- 
cant difference in group centroids since the tabular F-value 
is 1.44. The MANOVA test calculated an een Of 10.62 
with vi = 42 and v2 = 320. This test also indicated a 
Statistically significant difference in group centroids because 
the Festatistic table value is 1.42. 

Therefore, with both DISCRIMINANT and MANOVA tests 
agreeing, Hypothesis E is rejected. There is a significant 
difference in the educational levels used as reported in the 
interview data versus those reported in Delphi B. 

8. Hypothesis F Test Results 


The last hypothesis to be tested concerns needed 


Hypothesis F: There is no difference in the educational 
"levels needed" as reported in the interview 
data versus those reported in Delphi B. 


Pairwise variable Student's t-tests results are contained in 
Table 8. Fourteen of the 42 educational levels needed 
[33.3%] had statistically significant difference in their 
means. 

DISCRIMINANT analysis calculated an F-statistic of 
9.76 with vi = 38 and V2 = 321. This indicates that a 
significant difference in group centroids exists since the 
tabular F-value is 1.44. MANOVA analysis also concluded that 


there is a significant difference in group centroids with a 
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computed Feratio of 10.17 and v; = 42 and v2 = 319. The 
F-statistic table value is 1.42 at the 0.05 Significance level. 

Accordingly, with both discriminant and MANOVA 
analyses in agreement, Hypothesis F was rejected. There is 
a difference in the educational levels needed as reported in 
the interview data versus those reported in Delphi B. 

9. Hypothesis Evaluation Summary 

Tyo major conclusions result from the hypothesis tests: 
(1) In all three cases [Delphi A2 versus first iteration, 
interview versus Delphi B (educational level used), and 
interview versus Delphi B (educational level needed)], the 
variance decreased. With additional Delphic iterations one 
should be able to pursue a possible cause/effect relationship 
between fecedback/variance. 
(2) Data from the first output iteration was not significantly 
different from Delphi A2 data [it came from the same source], 
but interview data was not so similar. [It came from different 
sources.] This can imply several things, but later it will 
be shown that the interview data just rated the educational 
proficiency levels one "notch" lower on the whole, but with 
close to ths same ranking priorities as did the (educational) 


Delphi B.- 
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VI. ANALYSIS OF DATA 


This section briefly reviews the stages of morphological 
analysis as they apply to the reSearch and presents a 
discussion of value criteria application. The analysis of 
data collected within this research was time-limited, there- 
fore this section has been designed not only to present the 
results of that analysis, but also to point out to the reader 
that there is a great deal of analysis yet to be done. 

Upon completion of the preliminary stages of data 
collection, computerization, and unanalyzed data presentation, 
it became apparent that the methodology developed thus far 
could easily apply to the study of other "communities" of 
specialized individuals. In addition to the broad potential 
usefulness of the methodology and research instrumentation, 
it was felt that the analyzed results of Such a study could 
also be of interest to a wide and diverse audience. This 
multi-level applicability is an inherent strength of the 


morphological approach to "community" studies. 


A. MORPHOLOGICAL ANALYSIS 

It is necessary at this point to briefly review the stages 
of morphological analysis (as conceived by Zwicky and modified 
in this research) in order to better euadaice the multi-level 
applicability of both the methodology and the results.. 


Mophological analysis begins with a problematic statement. 
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ibe promienatic Statement 
The problem statement for this research was: "Describe 
the naval intelligence community." The statement was purpose- 
fully made in general form, in keeping with the morphological 
concepts presented by gwicky.- The results of this research 
do indeed "describe" the community and do so in terms of the 
parameters set down at the project's conception. 
2. Parameters 
In this project, data was collected within functional, 
organizational, educational, and personal parameters. The 
parameters to be selected for similar studies of other 
specialist communities could be defined in accordance with 
the appropriate project goals and objectives. In a broadly 
descriptive analysis such as this one, the parameters are 
designed with several variables common to two or more 
parameter areas, allowing an overlapping of data, and facili-~ 
tating data collection. 
3. Divergence 
The usable information collected with this parameter 
system quickly becomes diverse, as the morphological process 
mushrooms into vast amounts of seemingly unrelated data. 
This period of divergence is then brought under control by 


the establishment of various research constraints. 


so wicky and Wilson, New Methods of Thought and Procedure, 
pm. 100. 
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4. Constraints 

A constraint is applied during morphological research 
when the data gathering process threatens to obscure, in a 
plethora of unrelated information, the project's ultimate 
solutions. The constraint is specifically designed to control, 
rather than limit, the amounts of data to be collected within 
a given parameter. There are, of course, various constraints 
Over which the researchers have little control, and are set on 
the project by environmental effects. An example within this 
research was the constraint imposed by classification and 
security regulations. In any case, care must be taken to 
insure that the constraint does not in any way bias the data 
or the resulting analysis of that data. If a constraint will 
unavoidably bias the data (as in the case of this project's 
"yank" constraint) the bias must be taken into account during 
the analysis process. Properly applied constraints tend to 
converge the data collection and focus it toward providing 
information useful to the research conclusions. 

5. Convergence 

The process of convergence, brought about by careful 
application of research constraints, “oes not in any way limit 
the usefulness of collected information, but rather provides 
the researcher with data more specificaily germane to the 
Study. The fo. or focusing of the data relevant to 
the problem, allows the researcher to begin the last procedure 
in morphological analysis, the application of the selected 


value criteria. 
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The end product of this research is a vast data base 
with several hundred cases and related variables, all 
providing a large amount of potential information. What 
remains to be done is to query the data bank for specific 
areas of interest or value criteria. At this writing, almost 
a year has been spent in developing the methodology and data 
instrumentation necessary to support and perform a descriptive 
analysis of the intelligence community. Analysis-in-depth, 
in accordance with the questions posed by various areas of 
interest, promises lucrative results. Applications of the 
now existing methodology to other communities will yield data 
in a more timely manner, allowing similar research projects 
to devote more time to analysis. The analysis performed in 
this project was necessarily time-limited to a single value 
criteria application, and by way of example, the researchers 


chose to analyze the data from the point of view of management. 


B. VALUE CRITERIA 
ie ineroductlon 

Although many of the Navy's managerial problems do 
not differ significantly from the ones facing any large 
organization, there are certain unique aspects peculiar to 
Naval institutions. These aspects are the results of the 
changing size of the Navy's organizations, the diversity of 
its requirements, the mobility and dispersion of its assets, 
and the rapid turnover and reassignment of its personnel. 


The cumulative result is an organization in a state of 
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continuous flux. Consequently, reorganization, consolidation, 
and expansion are continual ongoing managerial processes 
directed toward improving naval effectiveness and efficiency. 

There are many methods available For Meena ine about 
improvement. They all uSe one or more tools to arrive at 
decisions. This section discusses the application of value 
criteria to specific instances. Although applications will 
be directed toward naval intelligence, it should be obvious 
that far wider applications can be made to other areas or 
communities. - 

The analysis which follows is by no means comprehensive 
but it should provide the reader with some indication of the 
applicability, versatility, and importance of the methodology. 
This will be accomplished through the following open-ended 
approach: proposing an area of potential interest, providing 
a brief description and application of a statistical methodol- 
ogy, presenting the results, proffering other points of 
interest, and proposing potential applications. This analysis 
applies the value criteria to primary levels of managerial 
concern: the organizational level and the personal develop- 
ment level. 


2. Managerial Criteria Applied at the 
Organizational Level 


dee PuneeTona lL 
One of the most important managerial aspects to 
be considered at the organizational level is the actual function 


or set of functions which is associated with a billet ora 
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position within an organization. There are many facets which 
a manager must consider when undertaking an evaluation of his 
Organization or when planning for future contingencies such 
as cutbacks, reorganizations, or expansion. Some typical 
questions which he may ask are: 


(1) What kind of functions are associated with each 
position or billet? 


(2) Can the position or billet be identified with or placed 
within a broader or more generalized type or grouping 
of jobs? 

(3) How much time is spent in direct, job-related functions 
and how can effectiveness be improved by assigning 
non-job-related functions to non-specialist personnel? 

(4) Who is filling specific positions or billets and what 
are his potential capabilities based on his background 
and experience? 


(5) Can any person be used more effectively within the 
organization? 


Answers to some of these and similar questions can 
be obtained simply by direct query of a data base (i.e., 
Appendix G). The more detailed questions erates more complex 
answers, derived by methods structured to a manager's needs 
and interpreted as appropriate for the een. Other 
questions may require answers derived by the latest and most 
sophisticated statistical procedures. 

One such question, of high interest in this project 
and related to the questions above, was whether or not certain 
broadly defined ‘aebel common to widespread locations and 
organizations, existed within the field of study. Theoretically 


such a job-type would be characterized by a specific grouping 


138 





of outputs which would be common to all the respondents 
who performed thateaopr 

Computer analysis was performed in two steps. 
First, the data was tested to determine whether or not 
clusters of outputs varied together as groupings. Second, 
the respondents who performed generalized sets of functions 
were identified. 

The initial search for clusters was performed 
uSing factor analysis techniques contained within the 
Statistical Package for the Social Sciences (spss) ,* a set 


of computer programs available to the researchers. Two 


schemes for orthogonal factor rotation were used, QUARTIMAX? 


and VARIMAX. 4 No groupings were identifed using these 


1 ee ea wwe 
techniques, nowever. 


ele, Norman, Statistical Package for the Social Sciences, 


STi d., p. 223; "The guiding principle of QUARTIMAX 
rotation is to make the complexity of a variable minimum, that 
is, to rotate the initial factors in such a way that a 
variable loads high on one factor, but almost zero on all 
others." 


Etbid., p. 224; "In contrast to QUARTIMAX, which centers 
On simplifying the rows of a factor matrix, the VARIMAX 
criterion centers on simplifying the columns of a factor 
matrix. Note that in QUARTIMAX many variables can load high 
or near high on the same factor (becauSe the main focus is ° 
on simplifying the rows), but VARIMAX defines a simple factor 
aS one with only 1's and 0's in the column. 

Such a simplification is equivalent to maximizing the 
variance of the squared loadings in each column. Hence the 
name VARIMAX. This method of rotation is the most widely used 
and is in a way a modification of QUARTIMAX." 
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Further searching for clusters was performed 
using partial correlation techniques” which are also contained 
within the SPSS package. Two major output clusters resulted: 
a. "Administrator": Intelligence Office Administration, 
Resource-Organizational Management, 
Budget and Fiscal Plans, 
Physical Security. 
ib. ‘Analyst": Briefs and Debriefs, 
Data Analysis 
Intelligence Annexes to Operational 
Orders (OPORDS), 
Estimates, 
Intelligence Information Reports, 
Orders of Battle (OOB), 
Tactical Plots. 
A minor grouping, consisting of Intelligence 
Collection Plans and Intelligence Collection Tasking, also 
resulted. In order to test whether or not the cases associated 
with the two major groupings prevented other such output 
clusters from being identified, another analysis was performed 
on only those cases which indicated that less than 50% of 
their time was spent performing either major cluster or 
outputs. No new grouping appeared. 
After these two clusters of outputs, named 
"administrator" and "analyst", had been identified, the next 


step was to isolate the actual cases which were associated 


with the outputs themselves. Immediately there was the 


THE Gap pp. 157-173; Partial correlation pairs every output 
variable against every other output variable, while controlling 
for rank, in order to derive a measure of association for each 
combination of variables. 
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problem of determining how much time must be devoted to one 
of the groupings of outputs before a person could be identi- 
fied as performing that general job-type. An arbitrary value 
of 60% was assigned. Using this 60% figure as a minimum 
value for selection, 38 respondents (12%) were identified as 
"administrators", and 34 respondents (10%) were identified 

as "analysts." Since only two aaa 62) met the minimum 
value for the grouping which consisted of Intelligence 
Collection Plans and Intelligence Collection Tasking, this 
cluster was not considered to be a generalized job-type. 

It was thus determined that only two general job- 
types could be identified: a) administrator and b) analyst. 
These two categories included 11 of the 19 listed outputs 
(58%) but accounted for only 22% of all respondents. Even 
lowering the selection value to 50% of total work time, the 
clusters accounted for only 35% of all cases. Increasing the 
selection criteria to what is perhaps a more realistic require- 
ment level of 70%, reduces the total explanation to the 
unacceptable level of 13%. 

The conclusion can therefore be drawn that there 
is a large number of people who produce similar outputs in the 
naval intelligence community, but that their functions do not 
fall into easily generalized job-type categories. Further 
analysis and additional conclusions are possible at this 


point. 
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ber grascal: 

Although time constraints made it impossible to 
take more than a cursory look at the wealth of information 
available in the data, it was obvious from the beginning that 
many subjects of organizational interest to a manager could 
“have been investigated. Another such area was fiscal planning. 
Here, too, a manager could pose appropriate questions and 
expect to receive significant information. Questions might 
pertain to locations and descriptions of facilities and 
personnel involved in a given process, numbers and quality of 
material or logistic support required and provided, or funds 
and facilities needed for education and training. The list 
is indefinite in length and depends solely upon the imagination 
of the manager for applicability and completeness. 

c. Manpower Allocation 

Still another area of interest could be that of 
manpower allocation. From the data base it would be possible 
to extract a significant amount of information concerning 
personnel, where they are, how long they have been there, 
what they are doing, how long they expect to be there, what 
Pay grades they occupy, what jobs are being done, whether 
certain jobs might be consolidated or relocated, what educa- 
tional levels are located where and where they are needed. 

dad. Geographical or Spatial Considerations 

Many questions concerning geography or location 

would arise as a consequence of the above manpower considera- 


tions. Not only would a manager be interested in what was 
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happening where, he would also be interested in whether there 
were differences in what was happening in different places. 
He might want to know if there were differences between 
commands on different coasts or between commands in the 
continental United States and those in foreign countries, or 
between commands in different foreign countries. It might be 
beneficial to determine whether one area was more involved in 
analysis than another or whether more management expertise 
was required in one place than another. 


3. Managerial Criteria Applied at the 
Personnel Development Level 


The functional analysis discussed above demonstrated 
that the diverse range of billets open to today's subspecialist 
requires that he possess a broad educational background. The 
process by which the officer gains that background is a 
combination of formal training, on-the-job experience, and 
higher education. Naval management can utilize data, such as 
that collected by this project, to identify and trace the 
experience, training, and education of the officers under 
study. Of particular interest to this project was the impact 
of higher education on the intelligence community and it was 
to that area of personnel development that the researchers 
concentrated their limited analysis. 

Application of the managerial value criteria to the 


project's data base at the personnel development level was 
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undertaken with two primary "policy areas pertaining to 
higher education management" © Tneminds 

(1) The exercise of financial prudence, economy, 
control of funds, and flow of capital: Proper management of 
educational assets required continuous study, evaluation, 
demonstration, and experimentation.’ The methodology developed 
for this research provided data that is of value to the manager 
who attempts to evaluate the effectiveness of a particular 
program or curriculum within his community. 

(2) The coordination of objectives, functions, and 
activities of higher education: The management and coordina- 
tion of these elements requires an optimum level of communica- 
tion and cooperation between the institution providing the 
education and the community utilizing the product .° It was 
felt that the community study undertaken in this project was 
ideally suited to the task of gathering data pertinent to this 
area of interest, as the Delphi techniques not only solicited 
the data, but provided a measure of community participation 
unknown in earlier studies. 

Within these broad policy areas naval management may 


pose several specific questions: What educational subject 


Conad L. Hungate , Management in Higher Education, New 
York: Columbia University, 1964, pp. 8-ll. 


Tipia. 


S586, 
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areas apply most directly to individual billets within a 
community? If levels of expertise in these areas were 
established, how would the community describe its present 
use of the subject as opposed to the level it recognizes as 
needing? Once a generalized list of educational areas is 
identified and the various levels of expertise used and 
needed at present are stated, what does the community project 
as levels needed in the future? Finally, the manager must 
compare the requirements of the community to the objectives 
of the higher education programs offered, in light of the 
general policy areas discussed above. 

a. Educational Data 


It should be noted that the data used in the 


sample, and like the other parameter data in the base, it can 
be addressed by specific geographical location, organization, 
or several other definitive characteristics. 

The first stage of the educational data analysis 
was accomplished by computing the raw percentage of responses 
recorded in the four levels given for each educational subject 
listed in Delphi B (see Appendix B Sample C). The educational 
Subjects are listed in the tables included in this section. 
The scores resulting from the raw percentage computations gave 
only an indication of the levels most needed for each subject, 
but gave little information regarding the relative importance 


of the subjects compared to one another. 
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In order to provide ranking information, the 
Second step of this analysis utilized "Condition B" of the 
Law of Categorical Judgement developed by W. S. Torgerson.” 
This technique uses categorized, ordinal data (which is 
assumed to be normally distributed and independent among 
Subject areas) to derive an interval scale ranking of all 
educational areas listed on the Delphi. A computerized 
Method of Successive Intervals (presented in Appendix F 
Sample S) was developed from the Torgerson technique, and the 
Delphi B data was applied to it. 

The three categories of educational data from 
Delphi B ("Used", "Needed", and "Future") are presented in 
Tables 9 through 11, listing the forty-two subject areas ligt 
order of importance to the population responding. The left 
margin of each table signifies a standard normal distribution 
scale value, which is not amenable to percentage interpreta- 
tion, but does define the bounds of each level ("Expert", 
"Working", "Basic", and "No Need"). These educational levels, 
referring to the Beers required in each subject, were 
discussed in an earlier section. The tables provide informa- 
tion invaluable to educator and manager alike: the respondents' 
perception of the rank order of educational subjects relevant 
to the community, and their positions on a numerical scale 
relative to each other and to the bounds of each expertise 


level. 





aeteeon S. Torgerson, Theory and Methods of Scaling, New 
perk: John Wiley & Sons, Inc., 1958 , pp. 205-246. 
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TABLE 9 


EDUCATIONAL LEVELS USED — DELPHI DATA 
a ee 
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—U.S. Naval Forces 

Collection Systems 

Management by Objectives 

Personnel Management 

Threat/Net Assessment 

Soviet Air Force 

Soviet Merchant/Fish/Oceanographic 
Allied Capabilities 
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Communication Systems 

Soviet Strategic Rocket Troops 
Radar Systems 
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ADP Basic Interface Operations 
National/Naval Budgetary Process 
USSR Area Studies 

Soviet Ground Forces 
International Relations Theory 
Underwater Acoustics 

Sonar Systems 

ADP System Design/Management 
CpeEves 

ADP Hardware Operations 

Middle East Area Studies 
“Probability and Statistics 
Lasers 

European Area Studies 
China Area Studies 

ADP Programming 

College Algebra 

Labor Relations 

African Area Studies 

Latin American Area Studies 
Foreign Language 

Beginning Calculus 
Advanced Calculus 
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TABLE 10 
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EDUCATIONAL LEVELS NEEDED — DELPHI DATA 
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TABLE 11 


EDUCATIONAL LEVELS FUTURE — DELPHI DATA 
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A similar analysis was performed on the educational 
data gathered during the interviews, and the results are 
presented in Tables 12 and 13 for "Used" and "Needed" cate- 
gories. A Spearman's Rank Order Correlation Coefficient! 
was then derived to determine how well the interview data 
predicted the rank orders reported by the Delphi B reSponse. 
In this test, an "R" value of +1.0 results from perfect 
correlation, an "R" value of -1.0 results from perfect but 
inverted order, and a 0.0 means no correlation. The Spearman 
correlations were, for the "Used" category, an R value of 
0.75 and for the "Needed" category, an R value of 0.80. 

Interpretations of the rankings shown in Tables 
9 through 13 must be made with the thought in mind that the 
respondents were rating the educational areas only as they 
applied to the performance of their present jobs. The subjects 
were not measured as prerequisites for advanced training or 
Special skills. Thus judging "Calculus" unnecessary for 
naval intelligence officers because it ranks low on the three 
Delphi B scales is premature; what the community has ranked 
is the day-to-day use of calculus, which hides the fact that 
it was a prerequisite subject, in school settings, for many 
of the respondents. Several other items of interest can be 
noted from study of the tables: . 

(1) Trends Across the Data. All three Delphi 


B tables list the top five subject areas in the same rank 





105i aney Siegel, Nonparameteric Statistics for the 
Behavioral Sciences, New York: McGraw-Hill Book Company, 1955, 
ep. 202-213. 
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order, indicating that the community is in strong agreement 
as to the most important educational areas in the list. The 
community also seems to agree on the least important areas, 
as the bottom seven subjects showed only minor relative 
position changes and a gradual increase in expertise level 
with time. A shift upwards in knowledge required for all 
subject areas was noted in both the "Needed" and "Future" 
data, Signifying that the community believes the requirements 
of the future will surpass those of today. Subjects within 
the computer skills area increased in level the most across 
time. A projection was made across the data by comparing the 
relative rankings among the subjects on each scale while 
minimizing the value of the benchmarks (the expertise level 
numerical bounds) across the scales. While the benchmarks 
were considered to be good estimates of the level of expertise 
measured for the "Used" data, their positions on the "Needed" 
and "Future" scales must be judged with caution, due to the 
subjectivity of the data. 

(2) The High End. The highest ranking subjects 
on all three Delphi B scales included the basic communications 
emis. "Organization of Thought", “Briefing", and “Writing” 
were the top three subjects on the Delphi listings and were in 
the top five subjects ranked in the interviews. While it is 
no surprise that the community considers communication skills 
important, it is noteworthy that this much agreement was 


reached on any subject. 


es 





(3) The Low End. At the opposite end of the 
scales, the community more or less agreed that the various 
"Area Studies" were among the least important subjects. A 
possible exception was the "USSR Area shad iesue which ranked 
somewhat higher, being placed near the median on all three 
Delphi B scales. Applications of advanced mathematics also 
ranked consistently low on the Delphi B listings, as was 
pointed out earlier. 

(4) Technical Subjects. Knowledge of 
"Collection Systems" was ranked highest among the technical 
subjects, with "Communication Systems" placing second in 
interest. A significant change in the need for knowledge 


regarding "Lasers" was noted across the Delphi B scales, as 
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feemecue Shift ah coniptiter sll loedsccwsse 
community consistently ranked Soviet Military Capabilities 
above most technical subjects. 

(5) Management. The community recognized 
"Management by Objectives" and "Personnel Management" as the 
most important subjects in that field, and placed subjects 
relating to the budget process and resource management 
consistently around the median. 

A final comparison was made between the Delphi B 

rankings and the interview data. Allowing for minor position 
changes, the top ends and the lower ends of the scales 


corresponded well, as did the relative placement of most of 


the technical subjects. In both the "Used" and "Needed" 
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scales, the interviewers consistently placed the ranked 
subjects a full expertise level lower than did the community 
respondents. The areas of widest divergence occurred where 
the interview data placed computer skills and most "Area 
Studies" higher and knowledge of "US/Allied Capabilities" 
lower than they were rated by the community. Figure 4 
demonstrates graphically where the various subject areas fell 
in the four categories both for the interview data and Delphi B. 

As was the case with the functional (output) data 
discussed earlier, there are several other potential uses for 
the educational and personnel development level data contained 
in a study such as this. 

b. Career Patterns 

The advent of the Operational Technical Management 
System (OTMS) for naval personnel management ushered in a new 
emphasis on the importance of sub~specialists, and those 
billets in the shore establishment that require them. Analyses 
of specialized communities such as naval intelligence can 
provide OTMS with a great deal of information Bout billets. 
and the officers that fill them. OTMS is designed to insure 
optimum utilization of specialized officer personnel as they 
rotate between operational and support organizations. The 
personnel development level data provided by this and similar 
community analyses on aid the OTMS manager in fulfilling that 
system design goal by furnishing both the educational require- 


ments set by the organizations, and the present qualifications 
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FIGURE 4 
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KEY FOR FIGURE 4 
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held by the officers available. Further, these data may be 
recorded and correlated over time. 
c. Temporal Changes 

The dynamic design of this methodology can be 
capitalized upon by tasking analysts to monitor the educa- 
tional levels existing within a community such as naval 
intelligence as they change with time. Recurrent Delphi 
instruments, addressed to either billets or individuals, can 
periodically update the data originally gathered. Data 
analysis can then detect changes or trends in the community 
which may relate to the introduction of graduates from the 
Naval Intelligence curriculum, changes in the technical 
requirements of intelligence, or other factors. The OTMS 
Manager will also bene from temporal change study, as ne 
monitors and evaluates the sub-specialist detailing process. 

dad. Human Goals Impact 

The methodology and resultant data offered by 
community studies such as this one can easily be expanded in 
other related personnel development fields of naval interest 
Eweneas the Human Goals Program. Utilizing the Delphi tech- 
nique, attitude surveys can take on new relevancy for the 
community. When combined with other research objectives, 
human goals data can be gathered with mere legitimacy than 
has been the case in the past, and the Delphi technique can 
provide an excellent opportunity to communicate ideas of 


Such a program. 
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VII. CONCLUSION 


A. INTRODUCTION 

The concluding section of this paper returns to the 
original problematic statement made at the beginning of the 
research project and offers the solution to it. It then 
points out that the methodology developed during the course 
of this study of the naval intelligence community has potential 
application, because of its general nature and ease of data 
collection, to the study of other specialized communities such 
as those of Aviation Engineering Duty Officers and Computer 
Science subSpecialists. 

The reSearch process involved with this project has 
generated several "spin-offs" which have applications to other 
research efforts and projects. These by-products are discussed 
in this section and are followed by a list of recommendations, 
which are made in an effort to help those who may be considering 


undertaking studies such as this one in the future. 


B. THE PROBLEMATIC STATEMENT 

The problematic statement set down at the beginning of this 
research was: "Describe the naval intelligence community." 
Inherent in that statement was the assumption that there was 
an identifiable community of intelligence specialists and 
Ssub-specialists existing within the naval service, linked by 


some as-yet-unnamed commonalities. The hypothesized 


2) 






commonalities were loosely identified with the "parameters" 
of morphological analysis and the researchers began the 
processes of data collection and manipulation in order to 
arrive at the desired community Beccrie tons 

The intelligence community as it exists in the Navy has 
been described empirically throughout this paper and its 
appendices. The descriptions vary according to the specific 
parameter data addressed and the differing interests of the 
individual seeking the information. The results of the 
functional analysis in Section VI for instance, empirically 
support the "intuitive" statement that the community has few 
billets which functionally resemble one another. Even those 
billets which carry the same billet titles in different 
organizations seldom produce the same mix of outputs. 

Further demonstrating the flexibility of the research 
results, the c-mputerized base containing the community 
description can provide the data while controlling for 
geographical locations of billets or organizations, specific 
officer ranks involved, educational requirements or personal 
backgrounds, specific intelligence outputs or functions, and 
numerous Other factors and variables. 

To say that the naval intelligence community is diverse 
is to understate the entire project, and yet the data from 
this research can provide descriptions of the community that 
are as detailed or general as necessary, and aS numerous as 


the reSearchers posing the questions. 
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C. APPLICATIONS OF THE METHODOLOGY 
TO OTHER SPECIALIZED COMMUNITIES 


‘The advantages of this methodology over other more 
specific forms of community analysis lie in the essence of 
the morphological approach. The approach capitalizes on 
generality and can utilize a variety of data~gathering 
instruments. 

1. Generalities versus Specifics in Community Analysis 

Task analysis, as documented by the Manpower Management 

fe eit ate and other literature requires extensive in-depth 
Study of specifics relating to a particular job's outputs and 
functions. The depth of such analysis dictates that the 
research team be integrated into the organization under study 
and that each job be monitored continuously for long periods 
of time. The nature of Specialist communities Such as naval 
intelligence rule out most procedures necessary for "true" 
task analysis. Details of security, time available with 
individual officers, and problems associated with the fluidity 
of the community have been discussed earlier. TheSe considera- 
tions require that the methodology developed to study the 
community be one that allows flexibility, generality, and ease 
of population response. Morphological analysis, as modified 


and adapted to this research, fits those requirements well. 


A Manpower Management Institute, Techniques cf Task 
Analysis, Washington, D.C.: MMI, N.d. 
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2. Variety of Data-Gathering Instruments 

The ease with which morphological analysis can be 
applied to the study of specialized officer communities was 
aptly demonstrated by its variety of acceptable data- 
gathering instruments. Of all the instruments described 
earlier, the Delphi technique proved to be the most effective 
means to solicit necessary data and to insure a high popula- 
tion response. By providing the individuals with feedback 
concerning how their responses "fit" in with the overall 
community response, the Delphi generated increased interest 
in the project. Additionally, the Delphi technique was well 
suited to the computer facilities available locally, both for 
data collection and subsequent data processing. The generalized 
procedures concerning the Delphi technique discussed in earlier 
sections and described technically in the appendices can lend 
themselves well to applications in other community/curriculum 
studies. 

The generality of the methodology developed in this 
research, and the Seize. with which the data-gathering instru- 
ments can be generated and administered contribute to the 
Overall applicability of the approach to other communities 
of specialized individuals. Examples of other communities 
which might benefit from such a study might be Aviation 
Engineering Duty Officers (AEDO) and Computer Science 


Ssubspecialists (p-code 8530). 
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3. The Aviation Engineering Duty Officer Community 
AEDO billets exist within naval aviation, both at sea 

and in the shore establishment. The utilization of these 
highly specialized aviators and flight officers in sub- 
specialist billets, and additionally their attitudes and 
perceptions regarding that utilization, could be an interesting 
research objective which would lend itself well to study 
with this approach. Recommendations from the AEDO community 
regarding curriculum specifics would be easier to arrive at, 
Since most AEDO designates are graduates of the NPS programs 
and would therefore be more qualified to comment on the 
educational requirements of their community. 

4. Computer Science Sub-Specialist Community 

Computer Science (p-code 8530) and its related Svstems 

Management subspecialties make up a community that differs 
from AEDO and naval intelligence in that they exist through 
billets spread across the spectrum of naval organizations, 
ashore and afloat. While AEDO designates remain in the 
aviation community and since intelligence subspecialists 
rarely fill p-code billets outside naval intelligence, 8530 
designated officers can serve in billets in almost every 
community in the naval service. The possibilities of 
conducting analyses of the various computer science and 
Management subspecialist groups are faScinating and the 
potential relevance of such studies to the Operational 


Technical Management System (OTMS) is most promising. 
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Besides these two examples of communities which would 
benefit from a study such as this project, there are Several 
other suggested areas for similar research. One of the most 
interesting and potentially rewarding of these areas might 
be in the Medical Corps of the naval service. With the 
increased emphasis on health services in the Navy today, 
research methodologies such as the one outlined by this 
project can provide useful data for the efficient utilization 
of medical officer assets, both ashore and afloat. 

In the course of developing this methodology and 
conducting the research, several "Spin-offs" were generated 
which have value and applicability in other fields besides 


this analysis. 


Poe col IN-OFFS 


1. Highly Personalized Approach — 


—=} 


Using Computerized Procedures 


Extensive use of computer facilities allows the 
researchers to tailor their research vehicles specifically 
to the population. Letters were addressed to Saale ounce 
by name and were written in an informal language to catch 
the attention of the reader. In that way each reader felt 
personally involved rather than being put off by just another 
letter written in official "navalese." Succeeding letters, 
written by computer, AneTaed comments concerning each 
individual's previous submission. The project ended with 


another personalized letter which expressed gratitude for 
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the assistance provided and gave figures which showed how 
important each individual contribution was. 

All research vehicles were kept short, simple, and 
easy to complete. It was intended that no questionnaire take 
more than ten minutes to finish. In that way it was hoped 
that a significant number would be returned within a 
reasonable time frame. 

Once machine procedures had been set up, the project 
could have been expanded, with little difficulty, to include 
an even larger population (such as the entire naval intelli- 
gence community [1000+ billets]). The only significant 
problem would have been that of keeping track of such a 
"mobile panel." Although having more than 300 people involved 
in a Delphi panel is not unheard of, having more than 100 is 
uncommon. 

The response ratio was exceptionally high. Although 
Martino states that "Response rates typically run 50% or less, 
and six to eight weeks are sometimes required to get even 
that many responses ,"“ the researchers got an unprecedented 
80% to 85% return within successive 30 day periods. 
Considering that the project lasted more than eight months, 
that the population consisted of more than 300 individuals, 
and that there was movement of these individuals during this 


period, those return ratios were phenomenal. 


eMortine, Technological Forecasting for Decision Making, 
me o4. 
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2. Computerized Delphi Production Procedures 

Computerized analysis of data is common in the Delphi 
technique. Even interactive computerization, which is used 
to a lesser extent, iS not uncommon. The computerized 
printing of personalized questionnaires including feedback - 
of earlier responses, as discussed above, is considered a 
novel approach. Value judgments must be made however on the 
value of the resources expended versus the resultant return 
Of data. 

The ALGOL/FORTRAN linkage (which tied ALGOL, FORTRAN, 
and TPS together), once made, greatly simplified the necessary 
processing requirements. Heretofore undocumented procedures 
were used to "Link" ALGOL with FORTRAN in order to combine 
ALGOL's alphabetic-string manipulation capability with 
FORTRAN 's input/output capability. (See section entitled: 
"Computer Language and Packaged Program Coordination") 

3. Multivariate Analysis of Variance (MANOVA) 

The large number of variables associated with each 
of the various data collection instruments presented a problem 
in the area of methodological evaluation. In order to avoid 
some of the difficulties stated in Sackman's critical review 
of previous Delphi studies (See section entitled: 
"Methodological Evaluation"), an attempt was made to find an 
appropriate evaluative technique. Multidimensional analysis 
of variance waS One such technique but the only preprogrammed 


version of the procedure available was for one-way and two-way 
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analysis of variance algorithms. Finally a Cooley-Lohnes 
FORTARN MANOVA program listing was iocneeun This "Significant 
and powerful Poneek th the Cooley-Lohnes terminology) 
technique provided for up to a 50-way multivariate dispersion 
analysis calculation. Since their program logic could be 
expanded, it wasS appropriately modified and is now available 


for local use. 


E. RECOMMENDATIONS 

1. Do not try to use "Task Analysis" procedures for so 
large and diverse a population as the one studied here unless 
the research assets allow for more interviews, Dar eteecors 
observations, and other procedures described by the Manpower 
Management Institute. Such procedures were designed primarily 
to identify a relatively small set of low level tasks performed 
by a small number of individuals and must be expanded for this 
sort of research. The procedures require a degree of researcher 
familiarization which is very difficult given the number and 
complexity of jobs in a project as large as this.one. 

2. Consider including more operational billets in the 
interview phase. Interview data is easier to collect from 
the shore establishment but the exclusion of data from the 
Operational forces could bias the sample. 

3. Consider a method for positively and accurately 
identifying and coding sub-specialist billets. 

4. Do obtain respondent social security numbers. dineee 


are essential for keeping track of individuals over a long 
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period of time. When the original biographical data was 
being collected, the researchers were confused about how to 
retain the anonymity which all Delphi literature discussed. 
The researchers realized too late that the anonymity applied 
only to the relationships among respondents and not to the 
relationship between respondent and researcher. 

5. Do make provision for identifying billets within a 
command. Requesting Billet Sequence Codes (BSC) from the 
respondents themselves was not always successful. 

6. Do explain the Delphi procedure. It is still a 
technique with which relatively few people are familiar. 

7. Do be informal. Do be brief. Do be simple. Do give 
feedback. Research conducted in this manner will be rewarded 


with a high degree of response. 


168 






APPENDIX A 
INTELLIGENCE ORGANIZATION STRUCTURES 
“SAMPLE A 
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From: Commander, Naval Intelligence Command 
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Subj: Graduate Pea tion Task Analysis Research Study 


1. A group of student and staff members at the Naval. Post- 
Graduate School, Monterey, California, are conducting a task 
analysis of the naval intelligence community. The purpose 

of the study is to establish a data base for ascertaining 
present and future educational requirements. This data base 
will be used by the Board of Curriculum Review to evaluate 

and improve the Naval Intelligence Curriculum at the Naval 
Postgraduate School. Moreover, it will also establish a means 
Grereficeting field/fiect intelligence activity needs. 
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3. The nature of this study contains many inherent obstacles, 
foremost of whicli 15 the sensitivity of the information 

which must be discussed during the personal interviews. 

Please understand that this project has my personal support 
and anterest. I request that you give every assistance for 
aesuccessiul conclusion. The importance of providing intor- 
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The only way to realize the full potential of this vi ital 
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APPENDIX B 
SAMPLE A 


19 AUGUST 1974 DELPHI "A" QUESTIONNAIRE 


NAVAL POSTGRADUATE SCHOOL 


MONTEREY, CALIFORNIA - 93940 IN REPLY REFER TO 
NC4 (382) /bh 
AMAL IL 
AUG 1 9 1974 
To: Distribution 
Subj: Task Analysis Questionnaire, forwarding of 
Encl: (1) Task Analysis Questionnaire Instruction Sheet 


(2) Task Analysis Questionnaire 


1. It is requested that enclosures {1) and (2) be distributed 
within your command to the incumbents of all U. S. Navy LCDR 
through CAPT billets who are involved in the intelligence pro- 
cess. The questionnaire is an initial, deliberately unstruc- 
tured and loosely defined part of a more sophisticated research 
project which seeks to provide a model for improving the cur- 
riculum development, evaluation, and management process. The 
goal of this research is to validate a methodology which will 
insure the inclusion of present and future needs of the fleet 
for advanced educatiecn in the Naval Intelligence Curriculum. 
This research has the support and interest of Commander Naval 
Intelligence Command. 


2. The results of the survey will be analyzed by students as 
part of thesis research for a graduate level educational pro- 
gram. Anonymity of the responses is assured. Only aggregated 
statistical data will appear in published findings. Careful 
consideration has been given to the need for classifying re- 
sponses and the data which will result. The questions involved 
in this questionnaire are deemed sufficiently general in nature 
to preclude the necessity for classifying answers. If you judge 
otherwise, then follow standard procedures in classifying and 
returning the questionnaire. Your assistance in this matter is 


sincerely appreciated. 
LAMM het 


D5, Wo EIbase, 
By directr 


Distribution: 

USS SARATOGA (CV-60) (1) USS FORRESTAL (CVA-59) (1) 

USS INDEPENDENCE (CV-62) (1) USS RANGER (CVA-61) (1) 

USS KITTY HAWK (CV-63) (1) USS CONSTELLATION (CVA-64) (1) 
USS HANCOCK (CVA-19) (1) USS AMERICA (CVA-66) (1) 

USS ORISKANY (CVA-34) (1) USS KENNEDY (CVA-67) (1) 

USS MIDWAY (CVA-41) (1) USS ENTERPRISE (CVAN-65) (1) 
USS F. D. ROOSEVELT (CVA-42) (1)USS BLUE RIDGE (LCC-19) (1) 
USS CORAL SEA (CVA-43) (1) USS MOUNT WHITNEY (LCC-20) (1) 
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Distribution (Continued): 
NAF LAJES (1) 

NAS CECIL FIELD (1) 

NAS KEY WEST (1) 
COMIDEASTFOR (1) 

NB GUANTANAMO (1) 

NB SUBIC (2) 


JSTPS (12) 
COMCARGRU ONE (1) 
COMCARGRU TWO (1) 
COMCARGRU THREE (1) 
COMCARGRU FOUR (1) 
COMCARGRU FIVE (2) 
COMCARGRU SIX (1) 
COMCARGRU SEVEN (lL) 


MISSILE CENTER PT MUGU 
NOSIC (12) 

FOSIC NORFOLK (3) 
FOSIC LONDON (5) 

FOSIF ROTA (4) 

FOSIF WESTPAC (4) 
NUWEPNTRAGRUPAC (2) 
COMNAVAIRLANT (3) 
COMNAVAIREAC (3) 
COMFAIRMED (3) 
COMFAIRKEF (1) 
COMPATWING ONE (1) 
COMPATWINGSLANT (1) 
COMPATWINGSPAC (1) 
COMPHIBLANT (1) 
COMPHIBPAC (2) 
COMPHIBRON ONE (1) 
COMPHIBRON THREE (1) 
COMPHIBRON FIVE (1) 
COMPHIBRON SEVEN (1) 
COMNAVSOUTH/COMI15 (2) 
USSOUTHCOM (1) 
CINCEASTLANT (1) 
CINCUSNAVEUR (3) 
COMNAVFORJAPAN (5) 
COMNAVFORKOREA (1) 
CINC UNC/USF KOREA (10) 
COMICEDEFOR (1) 
COMANTDC (1) 
comusTDC (4) 
USMAC JUSMAG THAI 
COMSECONDFLT (5) 
COMTHIRDFLT (3) 
COMSIXTHFLT (4) 
COMSEVENTHFLT (7) 
CINCAL (1) 
CINCPAC (24) 
CINCPACFLT (18) 


ce) 


(1) 


uni) 


CINCLANT (15) 
CINCLANTFLT (10) 
NIPSSA (10) 

DIA (170) 

FICEUR (14) 

FICPAC (14) 
FICLANT (10) 

NISC (37) 
PACOMELINTCEN (4) 
LANTCOMELINTCEN (2) 
NIPSTRAFAC (2) 
CTF 168 (7) 

ue) ILS i (2) 
GGG See) 
ene 168.3 (2) 
FITCLANT (2) 
FITCPAC (3) 
COMNAVINTCOM (34) 
NFOIO (12) 

NISHO (7) 

NISO CHASN (2) 
NISO EUROPE (2) 
NISO JAPAN (2) 
NISO MARIANAS (1) 
NISO NEW ORLEANS 
NISO NEW YORK (2) 
NISO NORFOLK (2) 
NISO HAWAII (2) 
NISO PHILADELPHIA (3) 

NISO SAN DIEGO (2) 

NISO SAN FRANCISCO (2) 
COMCRUDESGRU EIGHT (1) 
COMCRUDESGRU TWELVE, (1) 
NAVCOSSACT (2) 
FASOTRAGRULANT BRUNSWICK (1) 
CNA (3) 

COMFLTCORGRU TWO (1) 
CCMCAPIBSEAFRON (4) 
COMEASTSEAFRON (1) 
COMSUBGRU FIVE (1) 
COMSUBGRU SEVEN (1) 
COMSUBGRU EIGHT (1) 
COMSUBLANT (2) 

COMSUBPAC (1) 

COMAEWWINGPAC (1) 
COMRECONATKWING ONE (1) 

vC ONE (1) 

VO ONE (3) 

vo TWO (2) 

COMATWING ONE (1) 

PHIBSCOL CORONADO (1) 


2) 






A TASK ANALYSIS OF THE NAVAL INTELLIGENCE COMMUNITY 


TO DETERMINE EDUCATIONAL OBJECTIVES 


Introduction 

The attached questionnaire is part of a research study being 
conducted at the Naval Postgraduate School, Monterey, California. 
The purpose of this study is to determine educational objectives 
which reflect current and changing needs of naval intelligence. 
It is anticipated that the final product will serve as the foun- 
dation for further study and as a part of the continuing process 


of restructuring the naval intelligence curriculum. 


5) 


This questionnaire is designed to acquire personal and back- 
ground information about your particular billet. When processed, 
this information will assist in the selection of the functions 
which best represent overall naval intelligence activities. Based 
on this information, key billets in Washington, Norfolk, and Hawaii 
will be selected for personal interviews in September 1974. 

This study pertains to tasks performed by naval officers who 
provide intelligence related outputs [See page 2 of enclosure 2]. 
Survey questions should be answered on the basis of what is required 


in the performance of the jobs or tasks which you presently perform. 


Security Aspects 


Careful consideration has been given to the need for classi- 


fying your response and the data which will result. The questions 


Enclosure (1) 
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ii 


involved in this questionnaire are deemed sufficiently general in 
nature to preclude the necessity for classifying your answers. If 
you judge otherwise, then follow standard procedures in classifying 


and returning the questionnaire. 


Handling 
A retum envelope is enclosed for your convenience. Question- 


naires and additional comments should be addressed to: 


Superintendent (Code 382, T. A. Group) 
Naval Postgraduate School 
Monterey, California 93940 


POLE OF CHES 1S WOR Ik, We Ghielolin, teote Mehvell icles steiner 


Curriculum Officer, AUTOVON 479-2111/2228. 
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I. Individual Information 
Command 
Billet Sequence Code 
Billet Title 
Office location 
Name 
Rank 
Age 
Designator 
Previous designator, if applicable 
Billet Subspecialty Code 
Respondent's Subspecialty Code 
Highest educational level achieved 


Specialized training used in this billet 


Is this your first intelligence billet? 
If not your first, how many years previous intelligence experience 
do you have, excluding this tour? 


How many months have you been in this billet? 


Enclosure (2) 
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II. Outputs and Time Allocation 


The following table lists the primary intelligence outputs 
which have been delineated by the research group. It is desired 
that you indicate the percentage of your time which is devoted to 
each of the various outputs. After completing this list, please 
indicate whether you feel each listed output is a valid output 
for the intelligence community in general. Space is also allotted 
for any additional outputs which you feel should be included. 


Valid? 
1. Administration of intelligence office ee 
2. Briefs and debriefs eee. eee 
3. Budgets and budgeting fee ee 
4. Charts and audio/visual aids oe es 
5. Counterintelligence studies Se 
6. Data analysis a eee 
7. Decisions and recomendations ee ap ee 
8. Estimates et eee 
9. Intelligence annexes to OPORDs a 
ior intellagence collection plans ie, i 
ll. Intelligence collection tasking a oe 
12. Intelligence Information Reports 2 
3 Inteiligence studies Pre eo 
14. Interface with ADP/telecommunications 


ES 

15. Orders of battle % 
16. Physical security % 
% 


17. Tactical plots 
18. Other intelligence outputs to be added: 


fal inet eS CEE nee eee ee: 
b. eee 
c. _ 
Slice Ue Se __% 
e. : Fe 
19. Non-intelligence related outputs % 
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Comments: 
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Card #1 


Card #2 


Card #3 


Card #4 


Card #5 


Card #6 


Card #7 


APPENDIX B 
SAMPLE B 


DELPHI "A" CODING FORM 


NAVAL INTELLIGENCE TASK ANALYSIS GROUP 
CODING FORM FOR FIRST QUESTIONNAIRE 


Jes eee ees bee Bee eee a eeeeh 
10 20 26 3 
Command Name 0 


>| | | [ | | | | | | | | | | | | | | | | | | | | | I> 
31 40 50 60 67 
Billet Title 


*>LL LIT ETL | til 
68 727374 7677 80 
UIC Q Ctry g Sequence 


SON 
Jap 


ERIS TE ES ED ENE SV DS Eo WS ee 
10 20 30 40 
Respondent's Name 
SOOSRS eee Eee ee ae oe ae 
14 Gy 4748 Gal sye Bele), 6061 656667 VII2Z7S IM? 80 
Billet SS Resp. SS 


Bog 
ih, 


6 
2 & Desig. Prev. First et Training 1 Yrs Mos Sequence 
2 O Desig. Desig. Code Code 6 a 
t | | eit | t ees 
1 5 Ce 13 17 21 25 29 33 
Percentages*Validity 
I) cl th Ll Nl ele 
37 4] 4S 4g 53 ae 61 65 68 (a 80 
Sequence 
> 
20 30 33 3536 36 


10 
First Additional Output Code Percent 
>} | | | { | | | | | | | | | | | | | | | | | | | | | | I | | | 4|| 


60 71 7374 7677 80 


s) 50 
Second Additional Output Code PercentSequence 


> 


20 30 Sel 8E8G ae) 


1 10 
Third Additional Output Code Percent 


Poet fe eet le ee | eee lee aa 5| 


aS 50 
Fourth Additional Output 


ies CaS ee a 


1 10 
Fifth Additional Output 


tenon aes 
77 80 
Sequence 


20 


30 


71 = 7374 7677 80 
Code PercentSequence 


~> 


esi sibel eels) Bal 
Code Percent % Non- 


Intell. 


em!) TTL Jif i a a i aT 
1 10 20 30 40 


Comments 


> 
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Li 
41 50 60 70 


Hoel ZI 
757677 80 
Sequence 


“Pp , 3003 






APPENDIX B 
SAMPLE C 


17 DECEMBER 1974 DELPHI "B" QUESTIONNAIRE 


NAVAL POSTGRADUATE SCHOOL 


MONTEREY. CALIFORNIA - 93940 IN REPLY REFER TO: 
NC4 (382) /bh 
LAM AL 
17 December 1974 


1. This is the third phase of the naval intelligence com- 
munity task analysis being conducted at the Naval Postgrad- 
uate School. The purpose of this portion of the analysis is 
to determine the current and changing educational reauirements 
of naval intelligence. This Deiphi Questionnaire, iike those 
in the past, is designed to take a minimum amount of your 
time. Your continued support is greatly appreciated. 


2. A total of 102 personal interviews was conducted in 
Washington, Norfolk, and Hawaii. The primary purpose of 

these interviews was to establish initial educational require- 
ment criteria. After every interview the researcher assigned 
a number to each applicable subject area. That number (1, 2, 
3, or 4) corresponded to the level of understanding which the 
billet holder indicated he used or needed to carry out his 
assigned duties (TABLE I). The first four columns of TABLE 

II contain the interview results expressed in percentages. 


3. The information which we ask you to provide below will 
expand our original interview data and +ill make it more 
meaningful. We request information from three different 
viewpoints: the educational areas and levels which you 
presently use in your billet, the areas and levels which you 
feel would enable you to do a more thorough job (need), and 
finally an estimate of the areas and levels which will be 
appropriate approximately ten years from now (future). 


4. We request that you complete the last three columns of 
TABLE II as they apply to your billet. Use the educational 
level rating system provided in TABLE I (1, 2, 3, or 4). Mark 
the first column (labeled "Vse") to indicate the level of the 
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subjects presently Used in the performance of your duties. 
Use the next column (labeled "Yeed") to indicate the level 
Needed for optimum job performance. Use the final column 
(labeled “Future") to provide an estimate of the educational 
levels which will be required by your billet approximately 
ten years from now. 


5. If you are no longer in the billet first surveyed, please 
respond as though you were, since your experience in that 
billet is what we want to draw on for the completion of this 
project. Thank you for your time and patience. 


4/ 


R. W. CHAPIN 
By direction 


TABLE I 


EDUCATIONAL LEVEL RATING SYSTEM 


"4" = Theoretical and Expert Capability 


Possess knowledge which allows one to conceptualize 
and execute the steps required to provide solutions. 


"3" = Working Knowledge 


Be sufficiently familiar to be able to communicate 
effectively with an expert regarding both a problem 
and a solution; not necessarily able to actually work 
a complex problem without supervision and outside 
assistance. 


"2" = Basic Knowledge 


Have general acquaintance with major concepts, capabil-_ 
ities, and limitations. i 


"1" = Not Used or Not Needed 
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None 


% at each level 
(interview data) 


1 


52% 
73% 
84% 
66% 
89% 


37% 
41% 
53% 
65% 
743% 
81% 


50% 
53% 


46% 
53% 
34% 
46% 
61% 
66% 
34% 


47% 

73% 
32% 
40% 
45% 
45% 
40% 


46% 
65% 
47% 


32% 
67% 
65% 
12% 


623 
33% 
36% 
31% 
493% 
13% 


15% 
31% 





Basic 


2 
36% 
16% 

8% 
22% 

8% 


25% 
26% 
31% 
23% 
18% 
14% 


39% 
273 


34% 
29% 
37% 
ples 
28% 
24% 
34% 
29% 
21% 
16% 
21% 
33% 
29% 
29% 
303 
20% 
29% 


35% 
12% 
20% 
50% 


20% 
31% 
28% 
39% 
32% 


25% 
28% 
17% 


Workin 


3 


10% 
92 
63% 
9% 


Bie 


32% 
302 
16% 
12% 
8% 
5% 


11% 
183% 


18% 
16% 
26% 
20% 
10% 

9% 
27% 
20% 
55% 


41% 
34% 
20% 
23% 
24% 


18% 
12% 
23% 


28% 
16% 
12% 
33% 
14% 
30% 
29% 
25% 
15% 
47% 
42% 
37% 


Expert 


& 

2% 
2% 
23 
3% 
0% 
63 
3% 
0% 
03% 
0% 
0% 
0% 
2% 
2% 


3% 


Math 


Area 
Studies 


Naval 
Forces Scrty Science 


Soviet Nat'l 


Blue 
Forces 


Management ADP 


Comm. 
€kill 


TABLE II 


EDUCATIONAL REQUIREMENTS 


Academic Area 


College Algebra 
Beginning Calculus 
Advanced Calculus 
Probability & Statistics 


Foreign Language 


USSR 

China 

Mid East 
Europe 

Latin America 
Africa 


Operations Analysis 


International Relations Theory 


Underwater Acoustics 
Sonar Systems 
Communication Systems 
Radar Systems 

Optics 

Lasers 

Collection Systems 


Threat/Net Assessment 
Nat'l Security/Intell Orgn. 


Soviet Naval 

Soviet Air Force 

Soviet Ground 

Soviet Strat. Rocket Troops 
Soviet Mer/Fish/Oceanographic 


U.S. Naval Forces 
Other U.S. Forces 
Allied Capability 





System Design/Analysis (Mgmt) 
Hardware Operations 
Programming 

Basic Interface Operations 


. 
Management by Objectives 
Personnel 

Financial 

Nat'l/Naval Budget Process 
Labor Relations 


Briefing 
Writing 
Organization of Thought 
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APPENDIX B 
SAMPLE D 


INTERVIEW SHEET AND DATA CODING FORM 


Name Command Date 


Questionnaire? 

a. What sort of educational background is required for that task/output? 
What are the intellectual tools most used? 

What would you liked to have studied? 

If available, what sort of correspondence course would you take? 
What sort of help do you need to call in? 

Are you time limited in this task? 

What is your most valuable educational experience (for this output)? 
What sort of pubs do you use: textual, graphical, or technical? 
Where does your output go (for each important one) ? 

In what form? 


o 


2 
‘ 


Sequence # 


7and 
eee 


PPBS 


; 
WH ow Mh 
. 





speach 


Admin 


2. Briefs 








3. Budgets 


4. A/V aids 


: forecasting; know. of US systems 
J 


Big (it 


omt. 


6. Data anal. 


Za De M. 


Sem e: Site 





9. OPORDs 





=) 
o 
Q 
° 
a 
a= 

2a] 
= 
o 
=] 
n 





=) 
RB 
Q 
ie) 

PP 
= 
ct 
o 

n 

ox! 





























idn 30s 


i8.c. 





know. of USSR forces; ADP-system design/programming/sys. op; m 
& 
n 
ct 
c 
a 
bh. 
© 
n 


18.d. 





18.e. 





3no/ut 


19. Billet in general 


History; foreign language; mathematics; ops anal; int'l rel; nat'l security affairs; u/w acoustics; EE; general 


science; 
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yeads fopensaad fastazodns :30nz4sut foqrrqobau ‘!Adoo faqnduos fattdwoo tTeue !*pzooo foztsarquds 


‘ 


!do 






1. Whom do you spend the most time with during its performance? 


2. What about his time; how is the rest of it spent? 


3. Identify key billets in this organization. 


4. Where in the output flow does this billet fall? 


5. Describe your turnover. 


6. What was the most difficult part of learning your new job? 


~! 
n) 


Are you calied in to help other desks? Personal or billet reasons? 








General comments: 
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ADP 


INTERVIEW DATA CODING FORM 


CASE # 
123 
CODER 


® level used 
w level needed 











College Algebra 
Beginning Calculus 
Probs & Stats 

Adv. Caiculus 


MATH 


Foreign Language 


USSR 

China 

Mid East 
Europe 
Latin Amer. 
Africa 


AREA 
STUDIES 


Ops Anal. 
Int'l Rel. 


U/W Acou. 
Sonar Sys 

Comm Sys 

Radar Sys 
Optics 

Lasers 
Collection Sys 








NAVAT 
SCIENCE 


Natl/Nav Budget Proc 
Threat/Net Assessment 
Natl Sec/Intell Oren 





NAT'L 
SECURITY 


’ Naval 

A.F. 

Ground 

Pvo 

SRT 
Mer/Fish/Oceano 


SOVIET 
FORCES 


Collection Sys ¢ 
Naval Strat/G.P. 
Other Strat/G.P. 

Allied Capability 


BLUE 
FORCES 


Sys Design/Anal (Mgmt) 
Hardware Opr. 

Software Opr. (Programming) 
Basic Interface Ops 








w Briefing 
i) ae 
2 4 Writing 
ox Organ. of Thought 
Collection Sys 

PERT 
Mgmt by Obj 
Personnel 


Financial 
Labor Relations 





MANAGEMENT 





row 






APPENDIX B 
SAMPLE E 
EXAMPLES OF 6 NOVEMBER 1974 


COMPUTE R-PRINTED DELPHI “A2" 
QUESTIONNAIRES 
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NAVAL POSTGRADUATE SCHOOL 
MONTEREY, CALIPORNIA 93940 


382) /TA 201 
V 1974 


Sea 
121 
6 NO 


DuEector ; 

Naval Ocean Surveillance 
Information Center 

4301 Suitland Road 
Washington, D. C. 20390 


Attn: LCDR Louis A. Rogers 


Dear Lieutenant Commander Rogers: 


_ This is the second phase of the naval intelligence 
community task analysis being conducted at the Naval 
Postgraduate School. We Glee sera yOur Pea ouee to our 
firs uestionnaire. We would now like fo provide you with 
a little feedback. 


The instrument we are using |. this time is 
@oustructed aS a part of a "Delphi" technique. In light of 
the overall community's answers to our first, questionnaire, 
we will ask you. to_ re-evaluate your original responses 
(which have been listed for you in TABLE wT. While not 
erempting to move the various time allocatious toward a 
consensus, the Delphi will help us arrive at a consensus of 
Eee eueere community's outputs and should help validate our 

ata base. 


The next phase will au cur Washington, Norfolk 
and Pearl interview data to the question o educational 
requirements in the community. First, however, we need your 
help in this phase. Incidentally, if you are no longer in 
the billet 7 eta | canvassed, please respond as though 
you were, and include the name of your relief. 


‘ The following is set up to take no more than ten 
Minutes of your time. We would appreciate your continued 
participation. 


: TABLE I is our . coded. version of the background 
ao Orma tion you provided in, response to our initial 
questionnaire. PeeCoscemonecm it TOr eB@cCuracy aid mare 
corrections. aS necessary. Please make all corrections and 
additions directly on this letter. 


ce cm ee nee ee a mee a ce ee ee ee ee ee we ee ae i ee ae Se es Se ee 


TABLE I 
COMMAND NAHE: NOSIC 
BILLET SEQUENCE CODE: 19070 
BILLET TITLES HEADJMARITIME OPERATIONS BRANCH 
RESPONDENT'S RANK: LIEUTENANT COMMANDER 
BO PONDENT'S AGE: 35 
PoSoPONDENT'S DESIGNATOR HISTORY: 1110 
BeeeLET SUBPSPECIALTY CODE: ‘2108 
PeoPONDENT'S SUBSPECIALTY CODE: 72108 
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EDUCATIONAL LEVEL: BACHELORS LEVEL 
PRAINING USED IN THIS BILLET: 

DEFENSE INTELL SCHOOL 
feet INTELLIGENCE BIELEr? YES 
YEARS PREVIOUS INTELLIGENCE EXPERIENCE: 00 
PONTHS IN THIS BILLET: 21 


a cm ne ee ee se ee er en ee ee ee ee ee ee me ee es ee ee ee ee ee ew ee re ee ee te re we ee ee ee ee ee ats ee ee ee ee ee ee 


In the first column below is our original list of 


intelligence outputs. AS you renember we asked you to 
indicate the percentage of time which you devote to each of 
fPmese Outputs. The following data were compiled from the 


information provided Dy the 321. respondents o the first 
questionnaire. ieee mescecond column of TABLE TI/isvtie 
percentage of respondents who indicated that the output was 
Pplicable to their jobs. The third column contains the 
Been bet centage or time engaged in that _ output by those 
considering the Suet ceeticabie. The fourth column lists 
your responses to the first questionnaire. 


a ce ee a ee ee we ee ee ee ew ws ee ew we ea we a ee ee ae a a i ee 


TABLE II 
Be RiGeNe MEAN FOR 
THOSE BILLETS 
ORTGINAL LIST OF OUTPUTS ouTDar Withe RESPONSE 
OUTPUT 
fee Administration of 

Intelligence Office 85% 22% 020% 
2. Briefs and Debriefs 18% 9% 003% 
3. Budgets and Budgeting S4u% 6% —% 
4“. Charts/Audio/Visual Aids 50% 5h —% 
5. Counterintelligence 

Studies 16% 5% -% 
6. Data Analysis 59% 15% 005% 
7. Decisions and 

Recommendations 86% 17% 020% 
8. Estimates 45% 9% 010% 
9. Intelligence Annexes 

to OPORDsS 26% 5% -% 
10. Intelligence 

Collection Plans a5: 6% = 


141. Intelligence Collection 
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Tasking 43% 7% ~ ho 


12. Intelligence Information 


Reports 37% 7% -% 
13.° Intelligence Studies 53% 10% 00 2% 
14. Interface with ADP/ 

Telecommunications 53% 12% 010% 
15. Orders of Battle 30% 5% = 
16. Physical Security 54% 4%, 002% 
Wee Tactical Plots 23% 5% -h 
**TNTELLIGENCE OUTPUTS ADDED; 
COUNSELING SUBORDINATES 003% 
ESTABLISHING REQUIREMENTS 005% 
INTER AGENCY LIAISON 005% 
OUTGOING REPORTS 015% 

MT light of the responses to our ist 
Guestionnaire and the interviews, we have, modified the 
eput 11st significantly. Using this revised list of 
outputs (pelon) , please provide revised percentages in the 


spaces provided. 


We ask you. reconsider the write-in outputs which 

fe added to our original list. We request that you break 

Dem dOwn into baSic elements. For example, your output 

COUNSELING SUBORDINATES might be broken down to 
counseling/training. 


Careful consideration has been given to’ the need 
meee clessifying your response and the ag Pes aiee data which 
wiil result. The, questions involved in is questionnaire 


are deemed sufficientiy general in nature to preclude the 


necessity for classifying your. answers. If ou judge 
Seemerwise, then follow standard procedures in classifying 
and returning, the questionnaire. Please return hvs 


questionnaire in the attached self-addressed envelope. 
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a i ce te ee ce i mm em ee ms eee me mre ee ee mee ee ee ee ee a ee a ee ee ee re ee 


1. 
2. 
3 
4. 
5s 
6. 


8. 

o. 
10. 
1. 
12. 
1s. 
14. 
Use 
iG 
Ue 
18. 
iad 
20). 


TABLE III 


(= 
je 
» 
n 
o 
[Ph 
10 
(cc 
(ct 
fo 
(c 
{ct 
14) 


Administration of Intelligence Office 
Resource/Organizational Management 
Budgeting and Fiscal Planning 
Decisions and Recommendations 

Briefs and Debriefs 

Liaison 

Charts and Audio-Visual Aids 
Counterintelligernce Studies 

Data Analysis 

Estimates 

Intelligence Annexes to OPORDs 
Intelligence Collection Plans 
Intelligence Collection Tasking 
Intelligence Information Reports 
Interface with ADP/Telecommunications 
Orders of Battle 

Physical Security 

Tactical Plots 

Non-Intelligence Related Outputs 


Counseling/Training 


Revised 


mc a ee re mr ew ee ee ree re we i ee we we a a ee = oe 


R. 
LCDR. 
B 


W. CHAPIN, 


Girection 
Coordinator, 


JC. 
USN 


Task 


Analysis Group (382) 
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NAVAL POSTGRADUATE SCHOOL 
MONTEREY, CALIFORNIA 93940 


382) /TA 208 


Nea 
121 
6 NOV 1974 


Commanding Officer 

Naval Intelligence Support Center 
4301 Suitland Road 

Washington, D. C. 20390 


Attn; CAPT Edwin L. Herring 


Dear Captain Herring: 


This is the second phase of the naval intelligence 


community task analysis being conducted at the aval 
Postgraduate School. We appreciate peur response to our 
firs uestionnaire. We would now like to provide you with 


a little feedback. 


The instrument we are _ using , this time is 
@enstructeéd aS a part of a "Delphi" technique. In. light of 
the overall community's answers to our first questionnaire, 
we will ask you. to_ re-evaluate our Original responses 
(which have been listed for you in TfAELZ IT}. While not 
attempting to move, the various time allocations toward a 
consensus, the Deiphi wili neLb uS arrive at a consensus of 
the entire conmunity's outputs and should heip validate our 
data base. 


The next phase will apply our Washington, Norfolk 
and Pearl interview data tc the question of e ucational 
peat rements in the comaunity. First, however, we need your 
Meme in this phase. Incidentaliy, if you are no longer in 
the billet oa canvassed, please respond as though 
you were, and include the name of your relief. 


; The following is set up to take no more than ten 
minutes of your time. “We would appreciate your continued 
participation. 


; _TABLE I is our coded. version of the background 
information you Provided in response tO Our anitzal 
guestlonnaire. Please check it f£OE accibdcy did make 
corrections, as necessary. Please make all corrections and 
additions directly on this letter. ; 


ee 0 ee te ce em re ce ee ee ee eee ee ee ee ee eee ee ee ee es ee ee 


TABLE I 
COMMAND NAME: NISC SUITLAND 
PeGLeT SSQUENCE CODE: 00145 
BILLET TITLE: HEADJ ADSIN DEPARTMENT 
BESPONDENT'S RANK: CAPTAIN 
RESPONDENT'S AGE: 44 
MeoPONDENT'S DESIGNATOR HISTORY: 1110 
Bee LET SUBSPECIALTY CODE: NONE 
PeeEONVDENT*S SUBSPECTIALTY CODE: 72108 
BOUCATIONAL LEVEL: BACHELORS LEVEL 


UG? 






TRAINING USED IN THIS BILLET: 
DEEPEN SEPINTSLL, SCHOOL 
Hinot INTELLIGENCE BILLET? NO 
YEARS PREVIOUS INTELLIGENCE EXPERIENCE: 0O7 
MOUTHS IN THIS BILLET: .09 


sem i ee mm re me cn ae es a re a nn re ee 


a ee eg eee ce ee es ee ce ee i ee es mess Se ee i ee ee ee 


; Meploethestarst column below is our original list) of 
intelligence outputs. As _you remember we asked you to 
indicate the percentage of time which you devote to each of 
these outputs. The following data were compiled from the 
information provided by the 321 respondents O (tie —2irse 
questionnaire. in ecne. Second column of TABLE II as the 
percentage of respondents who indicated that the output was 
applicable to their jobs. The third column Contains the 
Bees bot cen tage Gr ftinevengaged an that output by those 
considering he Sue erator cable. The fourth column lists 
your responses to the first questionnaire. 


TABLE If 
PRESEN? be pon 
REPORTING INVOLVED YOUR 
ORIGINAL LIST OF OUTPUTS OUTPUT WITH RESPONSE 
OUTPUT 
1. Administration of 

Intelligence Office 85% 22% 020% 
2. Briefs and Debriefs 78% 9% -h 
3. Budgets and Budgeting 54% 6% 005% 
4. Charts/Audio/Visual Aids 50% 5% = 
5. Counterintelligence 

Studies 16% 5% -h 
6. Data Analysis 59% 15% 013% 
7. Decisions and 

Recommendations 86% 17% 050% 
8. Estimates U5% 9% none 
9. Intelligence Annexes 

to OPORDS 26% 5% none 
10. Intelligence 

Collection Plans 35% 6% none 
11. Intelligence Collection 

Tasking 43% 7h none 
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2. Intelligence Information 


Reports 37% 7% none 
13. Intelligence Studies 53% 10% none 
14. Interface with ADP/ 

Telecommunications 53% 12% 002% 
15. Orders of Battle 30% 5% -% 
16. Physical Security 54% 4% 005% 
17. Tactical Plots 23% 5% =i 
**INTELLIGENCE OUTPUTS ADDED: 
PERSONNEL SECURITY 005% 


ee i tt et ed 


ee en we me ee a ee ee ee we a a a a i i i i a a ae ew a ww ow 


: in ligne of the responses to Ob eee des & 
questionnaire and the interviews, we have. modified the 
Smtput list Significantly. Using this revised list of 
outputs Gees. please provide fevised percentages in the 
Spaces provided. 


We ask you reconsider the write-in output which you 
added to our original list. We request that you break it 


dowh ee Padshe Clesicuts. POL campis, (jour eoue de 
PERSONNEL SECURITY might be broken down to administration 
of intelligence GrELce, physical security, and 


counseling/training. 


Careful consideration has been given to the need 
Or on are iam toes response and the ee cs data which 
Maat result. The ee ions involved in this questionnaire 
are deemed sufficiently general in nature to reclude_ the 


necessity for ciassirying your answers. ene V8 , judge 
Otherwise, then follow standard procedures in c asene vid 
and returning the .questionnaire. Please return his 


questionnaire in the attached self-addressed envelope. 
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ee cee es ee ey ee ey re ee ee ee ce eee) ee ce Se ee ey ee eee ee ee ee ee ey ee ee ee ee ey ee ee eee ee ee ee ee er ee ee ee er es ee oe 


New list Of Outputs percentages 
ipeeacdministration of intelligence Office ee 
2. Resource/Organizational Management See 
3. Budgeting and Fiscal Planning ___& 
4. Decisions and Recommendations rae 
5. Briefs and Debriefs eres 
6. Liaison 2k 
7. Charts and Audio-Visual Aids eee 
8. Counterintelligence Studies ae 
9. Data Analysis cee 

10. Estimates ae 
11. Intelligence Annexes to OPORDs See 
12. Intelligence Collection Plans ___h 
13. Intelligence Collection Tasking eae 
14. Intelligence Information Reports fe: 
15. Interface with ADP/fTelecommunications Rees 
16. Orders of Battle ane 
17. Physical Security ___A 
fee Tactical Plots “vs Leah 
19. Non-Intelligence Related Outputs ___* 
20. Counseling/Training Sito s ten an 
100% 
Ro Wo CeRUAenthi, dics 
LCDR, USN 
Coordinator, Task 
Analysis Group (382) 
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NAVAL POSTGRADUATE SCHOOL 
MONTEREY, CALIFORNIA 93940 


NC4 (382) /TA 212 
qd 
6 NOV 1974 


Commanding Officer 

Naval Inteliigence Support Center 
4301 Suitland Road 

Washington, D. C. 20390 


Attn: CDR William M. Russ, Jr. 


Dear Commander Russ: 


This is the second phase of the naval intelligence 


community task analysis being conducted at the Naval 
Postgraduate School. We epee. our response to our 
firs eee we would now like to provide you with 


a Little reedback. 

The instrument we are . using , this time is 
constructed asa part of a "pelphi" technique. In,light of 
the overall community 's answers to our first, questionnaire, 
we will ask you, to re-evaluate your original responses 
(which have been listed for you in TABLE IIj., While not 
attempting to move, the VariGus Linc Sees Ons toward a 
consensus, the Delphi will help us arrive at a consensus of 
Eee eoete community's outputs and should heip validate our 

ata base. 


The next phase Will apply our Washington, Norfolk, 
and Pearl interview data to the, question oF educationar 
requirements in the Se First, however, we need your 
help in_this phase. Incidentally, if.you are no longer in 
the billet originally canvassed, please respond as though 
you were, and include the name of your relief. 


; The following is set up to take no nore than ten 
minutes of your time. We would appreciate your continued 
participation. 


ThBLE I is our .coded, version of the background 


information yOuULseprovided in response to our initial 
questionnaire. Please check it for accuracy and make 
Corrections aS necessary. Wwe would also like for you to 


indicate if you.are a_ WIS/DIS faduate: Y25_ 2 NOD 8 
eet ce make all corrections and additions directly oneenes 
etter. 


TABLE I 
COMMAND NAME: NISC HOFFMAN 
BILLET SEQUENCE CODz: 005v0 
PELLET TITLE: HEADS ELECTROMAGNETIC SYSTEMS DEPT 
RESPONDENT'S RANK: COMMANDER 
RESPONDENT'S AGE: 40 
RESPONDENT'S DESIGNATOK HISTORY: 1120 1100 
ECLLET SUBSPECIALTY CODE: 72109 





ReSPONDENT'S SUBSPECIALTY CODE: 721905 
EDUCATIONAL Levi: BACHELORS LEVEL 
MeeuNING USED IN THIS BILLET: NONE LISTED 


foreot INTELLIGENCE BILLET? NO 

VEARS PREVIOUS INTELLIGENCE EXPERIENCE: 0Q2 

PeNTHS IN THiS BILLET: 16 

t Peetieche farses column below 1s our original list of 
intelligence outputs. AS you remember we asked you to 
indicate the percentage of time which you devote LO Gach wat 
these outputs. The following data were compiled from. the 


information provided py the 321. respondents © (the (faret 
questionnaire. In the second colunn of TABLE II is the 
percentage of Fespondents who indicated that the output was 
@pplicable to their jobs. The third column contains the 
Peon percentage of time engaged in that output by those 
considering the geet appt tee S The fourth column lists 
your responses to the first questionnaire. 


TABLE II 
PHRCENT MEAN FOR 
THOSE ALI BES 
CHICO IN, AIC Se (Oe (OI OURS jiepur Wen RESPONSE 
CUTDUT 
1. Administration of 

Intelligence Office 85% 22% 045% 
2. Briefs and Debriefs 78% 9% 015% 
3. Budgets and Budgeting 54% 6% 015% 
4. Charts/Audio/Visual Aids 50% 5% —% 
5. Counterintelligence 

Studies 16% 5% =% 
6. Data Analysis 59% 15% -% 
7. Decisions and 

Recommendations 86% 17% 020% 
8. Estimates 45% 9% -% 
9. Intelligence Annexes 

to OPORDs 26% 5% -h 
10. Intelligence 

Collection Plans 35% 6% -%h 


11. Intelligence Collection 
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Tasking 43% Th —h 
12. Intelligence Information 


Reports 37% 7% -h 
13. Intelligence Studies 53% 10% ~h 
1. Interface with ADP/ 

Telecommunications 53% 12% -h 
15. Orders of Battle 30% 5% =% 
16. Physical Security 54% 4% -% 
ig. tactical Plots 23% 5% -%h 


me me ee ee ee eee ee ee ee ew we ee ee ee ee a a a ae i ea ae we ie a a a ae a ee i ae we a i ew ee = 


om mee ee me ee wee a ae eae ae a ae a ea ae a we a a a we ee ee ee ew ee ee 


in Light of the responses to our first 
questionnaire and the interviews, we have. modified the 
Output list ECS NO Using this revised list of 
outputs ects please provide revised percentages in the 
spaces provided. 


Careful consideration has been given to the need 
for eae si tying Your Eespouse and the aggregate data which 
Wil resu) hea anecstions involved tin iid s questionnaire 
are deened “sufficiently general in nature to Preclude the 
Meeeosity for classirying your answers. i you judge 
otherwise, then follow Standard procedures in classi yea 
and returning the uestionnaire, Please return his 
questionnaire in the attached self-addressed envelope. 
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cm arm cm eee te ee ge ce ee em ce re rm ee ee ee ee 


ile 
2- 
5 
4, 


6. 
ie 
8. 
a 
10. 
11. 


od 
v 


13. 
14. 
15. 
16. 
a7. 
18. 


19 


ve 


20. 


TABLE III 


New list Of Outputs 


Administration of Intelligence Office 
Resource/Organizational Management 
Budgeting and Fiscal Planning 
Decisions and Recommendations 

Briefs and Debriefs 

Liaison 

Charts and Audio-Visual Aids 
Counterintelligence Studies 

Data Analysis 

Estimates 

Intelligence Annexes to OFORDS 
Intelligence Collection Plans 
Intelligence Collection Tasking 
Intelligence Information Reports 
Interface with ADP/Teleconmmunications 
Orders of Battle 

Physical Security 

Tactical Plots 

Non-Intelligence Related Outputs 


Counseling/Training 


Revised 


Bi 38a Sf BA BA BM BA CDQ BABS BAC BR CBT 


rout 
el 


3s 32 34 38 22 


aad 


100% 


a eee ee ee ee ee ee om ee ey em ee ee ee ee ee ee ee i se ee Se SS ee a eee eee 


ce ne cp ce me me i i ne i cp me me em me in em me ee ee a ee ee i ee ee ee ee ee ee ee 


R. W. CHAPIN, 


LCDR, 


By direction 
Coordinator, 


alae 
USN 


Task 


Analysis Group (382) 
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NAVAL POSTGRADUATE SCHOOL 


' MONTEREY, CALIFORNIA 93940 


382) /TA 215 
v 1974 


NCU ( 
1240 
6 -NO 


Commanding Officer 

Naval Intelligence Support Center 
4301, Suitland Road 

Washington, D. C. 20390 


Attn: LCDR David A. Cotner 


Dear Lieutenant Commander Cotner: 


_ This -is the second phase of the naval intelligence 
community task analysis being conducted at the Naval 
Postgraduate School. We appreciate your response to our 
ELE Ss uestionnaire. We would now like to provide you with 
a little feedback. 


Tie SASL ruiment  wWemmare | using this tine Le 
constructed asa part of a "Delphi" technique. in dagnt yo. 
the overall commit ys avewiers  [O CULT LiLSt (questionaire, 
we will ask you  to_ re-evaluate our original responses 
(which have been listed for you in TABLE TI}. hee oe 
Seeeupesong ~c Move the various time allocations toward a 
PemsensSis, the belpni *ill help uS arrive at a consensus of 
the entire community's outputs and shouvuid help validate our 
data hbase. 


The next phase will apply our Washington, Norfolk 
and Pearl interview data to the question of educational 
Bequirements in the community. First, however, we need your 
help in this phase. Incidentally, if you are no longer in 
the billet originally canvassed, please respond as though 
you were, and include the name of your relief. 


; The following is set up to take no more than ten 
Minutes of your time. We would appreciate your continued 
participation. 


TABLE I is our coded. version of the background 


information you provided in, response to our initial 
questionnaire. Btease (check it ]).or accuracy and make 
corrections as necessary. We would also like for you to 


indicate if you are a NIS/DIS graduate: YES___ te Ge SAB 
‘oe make all corrections and additions directly on this 
etter. 


TABLE 1 
COMMAND NAME: NISC HOFFHAN 
BILLET SEQUENCE CODE: 00505 
BILLET TILLE: HEADS PRODUCTION MANAGEMENT DIVISION 
RESPONDENT'S RANK: LIEUTENANT COMMANDER 
PESCONDENT'S AGE: 35 
PeerrONDENT'S DeSIGNATOR HISTORY: 1320 
PELLET SUESPECIALTY CGDE: 72105 : 





RESPONDENT'S SUBSPECIALTY CODE: 72105 
EDUCATIONAL LEVEL: BACHELORS LEVEL 
TRAINING USED IN THIS BILLET: : 
OTHER TRAINING E.G. FAAWTCS/DESSCHOOL 
Biseol INTELLIGENCE BILLET? NO 
MEARS PREVIOUS INTELLIGENCE EXPERIENCE: 06 
MONTHS EN THIS BILLET: 15 
; . In the first column below is our original list of 
mitclizagence outputs. AS you remember we asked you to 
indicate the percentage of time which you devote to each of 
these outputs. The following data were compiled from the 


information provided ma the 321 respondents O -the Stirs 
questionnaire. Pieecie  seeond colunn “or TABLE © as the 
percentage of respondents who indicated that the output was 
applicable to their jobs. The third column contains the 
ieee bercenta e of time engaged in that output by those 
considering he output apdlicable. The fourth column lists 
your responses to the first questionnaire. 


ae ye ee ae ee ea we ee ee we es we ee es we ae a a a a i es a as ee es a a a ee = 


TABLE II 
PERCENT MEAN FOR 
THOSE BILLETS 
ORIGINAL LIST OF OUTPUTS jurpur ATTH te SEONG 
OUTPUT 
1. Adainistration of 

Intelligence Office 85% 22h 015% 
2. Briefs and Debriefs 718% 9% 002% 
3. Budgets and Budgeting 54% 6% 001% 
4. Charts/Audio/Visual Aids 50% 5%) 005% 
5. Counterintelligence 

Studies 16% 5% -hk 
6. Data Analysis 59% 15% =< 
7. Decisicns and 

Recommendations 86% 17% 008% 
8. Estimates . 45% 9% 005% 
9. Intelligence Annexes 

to OPORDS 26% 5% —% 
10. Intelligence 

Collection Plans 35% —— «6% 002% 


11. Intelligence Collection 
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Tasking 43% 1% 003% 


12. Intelligence Information 


Reports 37% 7h 003% 
13. Intelligence Studies 53% 10% 030% 
14. Interface with ADP/ 

Telecommunications 53% 12% 001% 
15. Orders of Battle 30% 5% -% 
16. Physical Security 54% 4% 005% 
17. Tactical Plots 23% 5h -% 

ine vg it of the (responses to OWL GEESE 
questionnaire and the interviews, we have, modified the 
Output list significantly. isrng  Ehis | revised —iivcreor 


outputs (below), piease provide revised percentages in the 
spaces provided. 


Careful consideration has been given to the need 
Ber classifying your response and the aggregate data which 
Will result. the questions involved ian this questionnaire 
are deemed sufficiently general in nature to creclude. the 
necessity for classifying your answers. If ou judge 
Otherwise, then follow standard procedures in c eee ee 
and returning ene “Guest ronnaire. Please return his 
questionnaire in the attached self-addressed envelope. 


207 





oe 
ry 


1. 
ian 
Bo 


o's 
6. 
v. 
8. 


10. 
ule 
p2. 
i. 
14. 
TS). 
iG. 
17. 
18. 
19. 
20. 


TABLE Lif 


New list Of Outputs 


Administration of Intelligence Office 
Resource/Organizational Management 
Budgeting and Fiscal Planning 
Decisions and Recommendations 

Briefs and Debriefs 

Liaison | 

Charts and Audio-Visual Aids 
Counterintelligence Studies 

Data Analysis 

Estimates 

Intelligence Annexes to OPORDS 
Jnteliigence Coliection Plans 
Intelligence Collection Tasking 
Intelligence Information Reports 
Interface with ADP/Telecommunications 
Orders of Battle 

Physical Security 

Tactical Plots 

Non-Intelligence Related Outputs 


Counseling/Training 


Revised 
Percentages 


a (eto! fae to obh k F fF 
| SS Ee a 
BY BBQ a@ BA 32 BA B@ B® Bi B@ BG af aa B@ ag a4 


| 


aa 38 as 


a Oy Ee RES Om Oe ee ee ae ee cee we ee re es ee ce 


ee > ee ee ee 9 0m ee ct 0m 9 ee ee ee ee ee eee ee a eee ee ee 


~ Ws CHAPIN, Jr. 
LCDR USN 


R 

By direction 

Seer eee 
n 


Task 


alysis Group (382) 
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NAVAL POSTGRADUATE SCHOOL 
MONTEREY, CALIFORNIA 93940 


3902) /TA 219 


NC4 
121 
6 NOV 1974 


On 


Commanding Officer 

feat intelligence Support Center 
4301 Suitland Road 

Washington, D. C. 20390 


Attn: LCDR David H. Krieger 


Dear Lieutenant Commander Krieger: 


This is the second phase of the naval ee ence 
community task analysis pet ng conducted at the aval 
Postgraduate School. We preciate our response to our 
ens uestionnaire. We om now like to provide you with 
meeevttie feedback. 


Tie irstruient me Ve ok e  USing thus tine aL 
Senotructed as a part Of a peli! Lechiique. li light oF 
the overall community’ S answers to our firs questionnaire, 
Boeewill ask you Oo ce-evaluate your original responses 
(which have been listed for you in TABLE II while not 
attempting to move, the varlvuus Line ailecations toward a 
consensus, the Delphi will help us arrive at a consensus of 
the entire community's outputs and should help validate our 
data base. 


The next phase Cee A our fash pole Norfolk 
and Pearl interview data question ducational 
requirements in the Fane He aLig Shey eu etee. 48 need your 
help in this een Incidentally, if you are no longer in 
the biliet origina ae ei asce please respond as though 
you were, and acted he name of your relief. 


The following is set up to take no more than ten 
minutes of your time. We would appreciate your continued 
participation. 


TABLE I is our coded. version of the background 
information you provided in, response to our initial 
questionnaire. Please check it for accuracy and make 
corrections as necessary. Please make all corrections and 
additions directly on this letter. 


Se ee oe eee ane ee ee i ee ee ee ee ee we ee ee ee ee Se Se ee ee Se 


TABLE I 
COMMAND NAME: NISC SUITLAND 
BILLET SEQUENCE CODE: Q0200 
BILLET TITLE: HEADS ASW APPLICATIONS DIV 
RESPONDENT'S RANK: LiEUTENANT COMMANDER 
BESPONDENT'S AGE: 31 
MesPONDENT'S DESIGNATOR HISTORY: 1120 
meeLet SUBSPECIALTY CODE: NONE 
PeeeOUNENT YS SUBSPECTALTY CODE: NONE 
EDUCATIONAL LEVEL: BACHELORS LEVEL 
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TRAINING USED IN THIS BILLET: 
DEEENSE CNTELL SCHOOL 
Pee ST INTELEDZGENCE BILLET? NO 
PRS PREVIOUS INTELLIGENCE EXPERIENCE: 05 
PONTHS IN THIS BILLET: 02 


eee ee ee 


we ee we ee we ee ee ee ee ee ee se i ee ee ee eee 


In the first column below is our oricinal list of 


intelligence outputs. As you. remember we asked you to 
indicate the percentage of time which you devote to each of 
these outputs. The following data were compiled from, the 


information provided =e the 321° respondents to the (first 
questionnaire. in the second column of TABLE II is the 
percentage or respondents who indicated that the output was 
applicable to their joobs. The third column contains the 
Been. ber centage of time engaged in that output by those 
considering he Oueetauel tcaple. The fourth colufn lists 
your responses to thé first questionnaire. 


we een ew eww ewe ew ew eww ew ew we ew ew ew em ew Be Oe ew wee wm we eO e@ wee eS OSB w we wee ew ee eee eS oe 


TABLE ITI 
PERCENT MEAN FOR 
THOSE BILLETS 
REPORTING INVOLVED YOUR 
ORIGINAL LIST OF OUTPUTS OUTPUT W1ITd RESPONSE 
OUTPUT 
fa Administration of 
Intelligence Office 85% 22% 020% 
2. Briefs and Debriefs 78% 9% 010% 
3. Budgets and Budgeting SUR 6% 001% 
4. Charts/Audio/Visual Aids 50% 5% 001% 
5. Counterintelligence 
Studies 16% 5% “fh 
6. Data Analysis 59% 15% 015% 
7. Decisions and 
Recommendations 86% 17% 020% 
8. Estimates 45% 9% 020% 
9. Intelligence Annexes 
to OPORDS 26% 5% -% 
10. Intelligence 
Collection Plans 35% 6% -% 
11. Intelligence Collection 
Tasking 43% Tk 002% 
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12. Intelligence Information 


‘Reports 37% 1% 001% 
13. Intelligence Studies 53% 10% 003% 
14. Interface with ADP/ 

Telecommunications 53% 12% 001% 
15. Orders of Battle 30% 5% 002% 
16. Physical Security 54% uh 002% 
47. Tactical Plots 23% 5% 002% 

: In light of the | responses ES) OUD Weriist 
questionnaire and the interviews, we have. modified the 
output list significantly. Using this revised list of 
outputs OLer please provide revised percentages in the 


Spaces provided. 


Careful consideration has been given to the need 
for classifying your response and the aggregate data which 
Will result. The questions involved in this questionnaire 
meemdcencd Sufficientiy general in mature to preciude the 
Beeessity ror cCilaSSityingy your answers. Ti yuu jaye 


Otherwise, then follow standard procedures in classifying 
and returning the SS Aa ae Piease return his 
questionnaire in the attached self-addressed envelope. 


Pada 





gee ee me ee me er ee me es ee me ee me ee es ce me ce ee ee ws es we es es se ee 


TABLE III 


New list Of Outputs percentages 
ieeeadministration of Intelligence Office 6% 
2. Resource/Organizational Management ea 
3. Budgeting and Fiscal Planning ee 
4. Decisions and Recommendations wee) 
5. Briefs and Debriefs mye 
6. Liaison ee, 
7. Charts and Audio-Visual Aids anes: 
8. Counterintelligence Studies = a 
9. Data Analysis axon, 

10. Estimates ___% 
11. Intelligence Annexes to OPORDs fen 
12. Intelligence Collectiou Plaus a.) 
13. Intelligence Collection Tasking eee) 
14. Intelligence Information Reports eee” 
15. Interface with ADP/Telecommunications eee 
16. Orders of Battle ms. 
17. Physical Security Res 
fies Tactical Plots op tcendene 
19. Non-Intelligence Related Outputs . nave 
20. Counseling/Training ee ee 

100% 


eg wey ee ce ee wee ee ee re ee ee ee ee ee ee ee ee ee Ss re ee ee ee 


re ee re ee ee we ee re ee wee re we ee rw ee ee re er ee re ee 


Rew CHAPIN, Jz. 
LCDR. ; USN 
By direction 
Coordinator, Task 
Analysis Group (382) 
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NAVAL POSTGRADUATE SCHOOL 
MONTEREY, CALIFORNIA 93940 


NCU (362) /TA 203 
121 
6 NOV 1974 


Commanding Officer : 
Naval peas denen es CCeSS2 Ng 
System Support Activity 

2461 Eisenhower Avenue 
Alexandria, Virginia 22331 


Attn: LCDR John S. Lierman 


Dear Lieutenant Commander Lierman: 


This is the second phase of the naval intelligence 


community task analysis being conducted at the aval 
Postgraduate School. We appreciate yous response to our 
first guestionnaire. We woulda now like to provide you with 


a little feedback. 


The instrument we are |using . this tine is 
Pemecructed as @ part Of a "Deiphi"® technique. In light of 
the overail community's answers to our first. questionnaire, 
we Will ask you, to_ re-evaluate your original responses 
(which have bvbeett listed fo. you in TABLE Giij., Whiie aot 
attempting to move the various time allocations toward a 
Penccnsus, the Deiphi will help us_arrive at a consensus of 
the entire community's outputs and should help validate our 
data base. 


The next phase will ave our Washington, Norfolk 
and Pearl interview data to the, question o educational 
requirements in the community. First, however, we need your 
meorinh this phase. Ineidentally, if you are no longer in 
the billet een eel canvassed, please respond as though 
you were, and include the name of your relief. 


, The following is set up to take no nore than ten 
Minutes of your time. We would appreciate your continued 
Paieerei DatsOn. 


: _TABLE I is our coded version of the background 
information you provided in, response to our initial 
questionnaire. Please check it for accuracy and make 
POErections as necessary. Please make all corrections and 
additions directly on this letter. 


SS me ee a ae ge cm wee tes ee ce ae oe ee we ey ec eS ee ee ee 


TABLE I 
CONMAND NAME: NIPSSA HOFFNAN 
BILLET SSQUENCE CODE: 00400 
BILLET TITLE: IDHS PLANNING + MGMT DIVISION HEAD 
RESPONDENT'S RANK: LIEUTENANT COMMANDER 
RESPONDENT'S AGE: 36 
RESPONDENT'S DESIGNATOR HISTORY: 1630 
Pee, SURSPECIALTY CODE; ‘2110p 
PESPONDENT'S SUBSPECIALTY CODE: 7219p 





EDUCATIONAL LEVEL: BACHELORS LeveL 
TRAINING USED IN THIS BILLET: 

- DEFENSE INTSLL SCHOOL 
mORSLT INTELLIGENCE BILLET? NO 
YEARS PREVIOUS INTELLIGENCE EXPERIENCE: 12 
MONTHS IN THIS BILLET: 13 


; Pee leet eee ecOLUnn below) 1s Our oOLig@paly Tist of 
intelligence outputs. AS you remember we asked you to 
indicate the percentage of time which you devote to each of 
these outputs. The following data were compiled from the 
information provided by the 321. respondents Othe ew first 
questionnaire. Pieertemesccond column Of TARDE Gal gis tne 
eae ncage of respondents who indicated that the output was 
applicable to tneir jobs. The third column contains the 
mean percentage of time engaged in that _ output by those 
considering he Qe vuermeepsicapie. The fourth coluineiiscs 
your responses to the first questionnaire. 


Oe ee we me we we re re ee ey oe ee ee er re Oe ee Owe ew Sw Oe eB Se wee Sw eee eS eS wee Sw ee See 


TABLE If 
PERCENT MEAN FOR 
THOS BILLETS 
ORLGIiNAL LIST OF OUTPUTS jareor eerae RESEONSE 
OUTPUT 
1. Administration of 

Intelligence Office 85% 22% 005% 
2. Briefs and Debriefs 78% 9% 005% 
3. Budgets and Budgeting 54% 6% ~h 
4, Charts/Audio/Visual Aids 50% 5% -% 
5. Counterintelligence 

Studies 16% 5% =h 
6. Data Analysis 59% 15% 025% 
7. Decisions and 

Recommendations 86% 17% —% 
8. Estimates U5% 9% -% 
9. Intelligence Annexes 

to OPORDsS 26% 5% -% 
10. Intelligence 

Collection Plans 35% 6% ~% 


11. Intelligence Collection 
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Tasking 43% 7% -h 


12. Intelligence Information 


Reports 37% 1% ~% 
13. Intelligence Studies 53% 10% -% 
WW. %Interface with ADP/ 
Telecommunications 53% 12% 025% 
15. Orders of Battle 30% 5% =x 
16. Physical Security 54% 4% -4 
ia Lactical Plots 23% 5% ~% 
*x*X INTELLIGENCE OUTPUTS ADDED: 
IDHS RESOURCE MANAGEMENT 020% 
IDHS PLANS AND MANAGEMENT 020% 
ela hit of the responses to OG ee LES c 
questionnaire .and__the interviews, we have. modified the 
re se ent come at hie cevised ist 9: 
Outputs (below), picaSe provide Tevisead percentages in the 


Spaces provided. 


We ask you. reconsider the write-in outputs which 

yeu added to our original list. We reguest that you break 

hem down into baSic elements. For example, your output 

IDHS RESOURCE MANAGENENT might be. | broken down iO 

Meee -e7 OF Ganizational | Management, liaison, and interface 
With ADP/telecommunications. 


Careful consideration has been given to the need 
ier classifying your response and the agg OG data which 
will resuit. ~ The questions involved in this questionnaire 
Bmesdeemed sufficien re general in nature to reciude the 
Meeessity tcor classifying your answers. I you _judge 
otherwise, then follow standard procedures in c¢ assreytng 
and (returning tne eee eine tee. Please return his 
questionnaire in the attached self~addressed envelope. 
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i a re re cr ar re re a ry es a wr me eee ye a ge ee ae oe ee ee we eo fe ee ey ee ee oe 


TABLE IIT 


New list Of Outputs percentages 

1. Administration of Intelligence Office eee: 

2. Resource/Organizational Management ee 

3. Budgeting and Fiscal Planning ee 

4. Decisions and Recommendations ee 

5. Briefs and Debriefs eel 

6. Liaison Bee 

fee Charts and Audio-Visual Aids dea 

8. Counterintelligence Studies es 

9. Data Analysis ___* 

10. Estimates eee 
11. Intelligence Annexes to OPORDs ey: 
12. Yutelliyeuce Coliection Plans ___- 
13. Intelligence Collection Tasking ___4 
14. Intelligence Information Reports ___& 
15. Interface with ADP/Telecommunications eee 
16. Orders of Battle ee 
17. Physical Security oe 
18. Tactical Plots Een 
19. Non-Intelligence Related Outputs ___% 
20. Counseling/Training ee, 
100% 


a ee me ee ee re ee ee ee ee Se a ee ee ee ee 


ee ce rr ee ee ee ee ee es ee ee ee ee ee ee ee i ee ee ae Se a ee ee 


R. W. CHAPIN, Jr. 
LOUR. ; USN 
By direction 
Coordinator, Task 
Analysis Group (382) 
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NAVAL POSTGRADUATE SCHOOL 
MONTEREY, CALIFORNIA 93940 


382) /TA 402 


NC 
12 
6 Vo 1974 


za 


{ 
0 


Commanager : 

Naval Intelligence Command 

Naval Intelligence Command Hqtrs 
2461 Eisenhower Avenue 
Alexandria, Virginia 22331 


Attn: LCDR Vincent H. De Vito 


Dear Lieutenant Commander De Vito: 


This is the second phase of the navai intelligence 


community task analysis being conducted at the aval 
Postgraduate School. We appreciate your response to our 
firs uestionnaire.,. We would now like to provide you with 


a little feedback. 


The instrument we are | using | this time is 
Memotructed as a part of a “Delphi® technigue. [In light of 
the overall community's answers to our first, questionnaire, 
we will ask you. to re-evaluate your original responses 
(Whicn have been Listea tor you in YALE ae WN2Le not 
attempting to move the various time allocations toward a 
meonsensus, the Delphi will help us arrive at a consensus of 
Eee oe ° conmunity's outputs and should help validate our 

ava base. 


The next phase will eoty our Washington, Norfolk 
and Pearl interview data to the. guestion of educational 
requirements in the community. First, however, we need your 
help in this phase. Incidentally, if you are no longer in 
the billet Gir telly canvassed, please respond as though 
you were, and include the name of your relief. 


, The following is set up to take no more than ten 
minutes of your time. We would appreciate your continued 
participation. 


PiBLESt is Our coded version oL the background 


information you provided in cesponse to our initial 
Mestionnaire. Please check it for accuracy_,and_ provide: 
billet subSpecialty code. We would also like for you to 
indicate it you.are a NIS/DIS decane te: ‘Oss pees Non! 
Please make all corrections and additions directly on this 
letter. 

TABLE I 
COMMAND NAME: COMNAVINTCOM 
Piece! SEQUENCE CODE: 50250 
PeobeT TITLE: HEAD SPECIAL SEC DET PENTAGON BRANCH 
Pee eCNDENT'S RANKS LIEUTENANT COMMANDER 
RESPONDENT'S AGE: 43 
RESPONDENT'S DESIGNATOR HISTORY: 1110 1100 1108 


Poly 





ij 


Delle LeothoPECTALTY CODE: 2 
RESPONDENT'S SUBSPECIALTY CODE; 7210E 
EDUCATIONAL LEVEL? BACHELORS LEVEL 
TRAINING USED IN THIS BILLET: 

PE Vee Nie lek PE RENCE 
Beko UNTELEPGENGS BILCET? NO 
YEARS PREVIOUS INTELLIGENCE EXPERIENCES 0Q3 
MONTHS IN THIS BILLET: 60 
; _ In the first column below is our original list of 
intelligence outputs. AS you remember we asked you to 
indicate the percentage of time which you devote to each of 
these outputs. _ The following data were compiled from the 
information provided by the 321. respondents Oo the fuse 
questionnaire. In .the second _.column of TABLE II is the 
percentage of respondents who indicated that the output was 
applicable to their jobs. The third column contains the 


mean, Sete of time engaged in that output by those 
considering he ee eee tice vie. The fourth colunn lists 


your responses to the first questionnaire. 


TABLE If 
PERCENT MEAN FOR 
THOSE Bi Lees ; 
ORIGINAL LIST OF OUTPUTS ourpur witg RESPONSE 
OUTPUT 
1. Administration of 

Intelligence Office 85% 22% 030% 
2. Briefs and Debriefs 78% 9% 030% 
3. Budgets and Budgeting 54% 6% -% 
4“. Charts/Audio/Visual Aids 50% 5% -% 
5. Counterintelligence 

Studies 16% 5% -% 
6. Data Analysis a97 15% ~% 
7. Decisions and 

Recommendations 86% 17% 005% 
8. Estimates 45% 9% = 
9. Intelligence Annexes 

to OPORDS 26% 5k =a 
10. Intelligence 

Collection Plans 35% 6% ea 
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41. Intelligence Collection 


Tasking 43% Th -% 
12. Intelligence Information 

Reports 37% ia —% 
13. Intelligence Studies 53% 10% -h 
14, Interface with ADP/ 

Telecommunications 53% 12% -% 
15. Orders of Battle 30% 5% -% 
16. Physical Security 54% 4% 035% 
dg. Tactical Plots 23% 5% -% 


ee me ee re we ee ee re we we er we ee re we we we we we ewe ee we we we we ee we we we ee eee ee ee ae eae ae ee oe 


ce ee swe we we we we re ee ee eae ee ee ee re ee we oe a ee we es ee eee ee ee ae eee a ee ee a 


in ligh & of the responses to our. first 
questionnaire and the interviews, we have modified the 
output list significantly. Using this revised list of 
outputs (below), please provide revised percentages in the 
Spaces provided.’ 


Careful consideration has been given to the need 
for eee eee 109 cone response and the aggregate data which 
will result he guestions involved in Bis questionnaire 
are deemed sufficiently general in nature Fe Gon. the 
necessity for classifying. your aoe goreas ou (judge 
Otherwise, then fore Standard procedures in SS) ae 
and returning pee e cunaete - Please return his 
questionnaire ae nee attached self-addressed envelope. 
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16. 
17. 
18. 
19. 
20. 


TABLE III 


Revised 
New list Of Outputs Percentages 


3a 


Administration of Intelligence Office 


| 


Ba 


Resource/Organizational Management 


Budgeting and Fiscal Planning 


] 
| 


Decisions and Reconmendations 


| 


Briefs and Debriefs 


| 


Liaison 


Charts and Audio-Visual Aids 


Counterintelligence Studies 


] 


24 BS BW Bf SY s@ sf se 3X 38 


Data Analysis 


Estimates 
Intelligence Annexes to OPORDS 
Intelligence Collection Plans 
Intelligence Collection Taskinrg h 
Intelligence Information Reports a 
Interface with ADP/Telecommunications % 
Orders of Battle % 
Physical Security A 
Tactical Plots va 
Non~Intelligence Related Outputs ra 
9 


Counseling/Training 


Ro Who (ClRyAPIUN, die. 
LCDR. USN 
BY direction 
A 


oordinator, Task 
nalysis Group (382) 
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NAVAL POSTGRADUATE SCHOOL 
MONTEREY, CALIFORNIA 93940 


NC 4 (362) /TA 404 
6 NOV 1974 


Commanding Officer 

Naval Investigative 
Service Headquarters 

2461 Eisenhower Avenue 
Alexandria, Virginia 22314 


Attn: LCDR Thomas £. Leach 


Dear Lieutenant Commander Leach: 


Tits) es the second phase of the naval phe oes 
community task ape Tats. pezd conducted at the aval 
Postgraduate School. igese pes our aoe onse to our 
first questionnaire. We youn now like to provid e you with 
a little feedback. 


The instrument we are using this time is 
@omstructed as 4 part ef a "Delphi" technique. in light of 
the overall conunity* S anSwers to our first. questionnaire, 
we will ask you, to_ re~evaluate your original responses 
Moyecs have Scen listed for you in TABLE _ 11). White not 
attempting to move the various time allocations toward a 
consensus, the Delphi will help us arrive at a consensus of 
the entire community's outputs and should help validate our 
data base. 


The next phase will apply our Washington, Norfolk 
and Pearl interview data to t question of e ucational 
requirements in the communit First, however, we need your 
heip in this phase. Inciden ally if you are no longer in 
the billet originally canvasse please respond as though 
you were, and include the name of your relief. 


The following is set up to take no more than ten 
Minutes of your time. We would appreciate your continued 
participation. 


TABLE I is our coded version of the backaround 


information you provided in response to our initial 
HestiOnulaire, Please check it for accuracy and rovide: 
illet | subspecialty code, ue pUbe ec cre ty code. e would 

ane° like for you to indicate if you are a WNIS/DIS graduate 


ers NO ? Please make ali corrections and Jad ceione 
directly on this letter. 


ec er cm mn me ce ce ce ee re en ee ee ey ee i ee ee ee ee ee ee 


TABLE I 
COMMAND NAME: NISHOQ 
BEELET SZQUENCE CODE: 900300 
DLELEL TITLE: COUNTER INTELLIGENCE ANALYST 
RESPONDENT'S RANK: LIcUTENANT COMMANDER 
RESPONDENT'S AGE: 37 ; 
RESPONDENT'S DESIGNATOR HISTORY: 1630 1355 


Zell 





Deo Gelesieor SCTALTY CODES 7? 

RESPONDENTYS SUBSPECITALTY CODE: ? 

EDUCATIONAL LEVEL: LESS THAN BACHELORS DEGREE 

FURAp ENON GUS Det Neeoie oe Bliiots NONE LiS TED 

FIRST INTELLIGENCE BILLET? NO 

YEARS PREVIOUS INTELLIGENCE EXPERIENCE: 0Q7 

HOUTHS SENS BILLET: 11 

: _ In the first column below is our original list of 
intelligence outputs. As you remember we asked you to 
indicate the percentage of time which you devote to each of 
these outputs. _ The following data were compiled from the 
information provided by the 321. respondents OO etane iarst 
questionnaire. In _the second coiumn of TABLE II is the 
percentage of respondents who indicated that the output was 
applicable to tneir jobs. The third column contains the 
Mean percentage of time engaged in that_ output by those 
considering he ope Ee ceus tcanle. The fourth coiumn lists 
your responses to the first questionnaire. 


TABLE II 
PERCENT MEAN FOR 
ORIGINAL LIST OF OUTPUTS GUTPUT WiTH RESPONSE 
OUTPUT 
ae AdmMinictration of 

Intelligence Office 85% 22% 010% 
2. Briefs and Debriefs 78% 9% 005% 
3. Budgets and Budgeting 54% 6% 002% 
4. Charts/Audio/Visual Aids 50% 5% 002% 
5. Counterintelligence 

Studies 16% 5% 055% 
6. Data Analysis 59% 15% -% 
7. Decisions and 

Recommendations 86% 17% 010% 
8. Estimates 45% 9% =% 
9. Intelligence Annexes 

to OPORDs 26% 5% ~h 
10. Intelligence 

Collection Plans 35% 6% —% 


11. Intelligence Collection 
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Tasking 43% 7% 001% 
12. Intelligence Information 


Reports 37% 74% -% 
13. Intelligence Studies 53% 10% -% 
14. Interface with ADP/ 
Telecommunications 53% 12% -% 
15. Orders of Battle 30% 5% -% 
16. Physical Security 54% u% 005% 
ieee Tactical Plots 23% 5% -% 
*XTINTELLIGENCE OUTPUTS ADDED: 
STAFF SUPPORT 010% 
In light or the responses to our fast 
questionnaire and the interviews, we have. modified the 
Ourput List Significantly. Using this revised list of 
outputs (henea. piease provide revised percentages in the 


Spaces provided. 


We ask you reconsider the write-in output which you 
added to our original iist. We reguest that you break it 
down into, basic elements. For example, your output STAFF 
SUPPORT might be broken down to resource/organizational 
managemert, charts and audio-visual aids, and data analysis. 


Careful consideration has been given to the need 
for. classifying your response and _the agG0 eda — data which 
will result. The cGuestioas involved in is” questionnaire 
are deemed sufficiently general in nature to preclude the 


necessity for classifying your_ answers. if. ou , gudge 
Otherwise, then follow standard procedures in classifying 
and returning, the questionnaire. Please return his 


questionnaire in the attached self-addressed envelope. 
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ee ae re ee ery ee mr me ne rr cme are em ce core mr a ae weer nm ee me re mt a ee ee a ee es we ee re ny ee ne ee ee es ee ey ee ne ee ee ee eee 


Ue 
Ze 
3. 
4. 
ae 


ve 

8. 

ve 
10. 
us 
12. 
Woe 
V4. 
Vol 
16. 
17. 
18. 
19. 
20. 


TABLE III 


New list Of Outputs 


Administration of Intelligence Office 
Resource/Organizational Management 
Budgeting and Fiscal Planning 
Decisions and Reconmendations 
Briefs and Debriefs 

Liaison 

Charts and Audio-Visual Aids 
Counterintelligence Studies 

Data Analysis 

Estimates 

Intelligence Annexes to OPORDs 


9) 2 = oe 6 eo eee e ie 
Intelligence Coisection hs 


pu 


4 
2h 


mY 


Intelligence Collection Tasking 
Intelligence Information Reports 
Interface with ADP/Telecommunications 
Orders of Battle 

Physical Security 

Tactical Plots 

Non-Intelligence Related Outputs 


Counseling/Training 


ee eee me ree eee ee ee me ey a sce ee ee ee es ce eg eg ee Se ce me EP OS ee eee eo ee ae 


Ae Ee eh OE ey A ee ES om 2 Se ape eee eo eC Oe Om ee oe ee Se me Se EO ee es Soe 


W. CHAPIN, 


R. 
LCDR. 
B 


direction 
Coordinator, 


Revised 
Percentages 
eee 
igs 
une 
eat. 
eee 
ey! 
Jae 
a, 
2S: 
ee 
___% 
Sak 
oe 
re 
ee 
eee 
see! 
aie.) 
aoe 
lek,” 
100% 
USK" 
Task 


Analysis Group (382) 
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NAVAL POSTGRADUATE SCHOOL 
MONTEREY, CALIFORNIA 93940 


C4 (382) /TA 410 
ie 
NOV 1974 


Officer in Charge. 
Navy Field Operational 
Intelligence Office 
Fort George _G. Meade 
Maryland 20755 


Attn: LCDR Paul R. Borcik 


Dear Lieutenant Commander Borcik: 


This is the second phase of the naval intelligence 


community task analysis being conducted at the Naval 
Postgraduate School. We appreciate Lone response to our 
fos uestionnaire. we would now like to provide you with 


a littie feedback. 


The instrument we are . prea _ this time is 
S@vecructed as 4d part of a "Delphi" Maga ine onto r 
the overall community's answers to our first. questionnaire, 
we ,Will ask you, to, re-evaluate your original responses 
(Which nave Leeh 2isted for you in TaBLE ij... while not 
attempting to move, the various time allocations toward a 
consensus, the Deiphi will help uS arrive at a consensus of 
the entire community's outputs and should heip validate our 
data base. 


The next phase will eubey our Washington, Norfolk 
and Pearl interview data to the questicn of educational 
geet ements in the commune EY First, however, we need your 
help in this phase. Incidentally, if you are no longer in 
the billet pease ty canvassed, please respond as though 
you were, and include the name of your relief. 


: The following is set up to take no more than ten 
Minutes of your time. We would appreciate your continued 
participation. 


TABLE I is our coded version of the background 


information you provided in _ response to our initial 
uestionnaire. PleaSe check it for eccuracy and provide: 
illet | sequence code, billet subspecialty code, your 
subspecialty code. We would also like for you  to_ indicate 
Gis you are a NiIS/DIS eee Ee: YES____, NO____?._ Please make 
all° corrections and additions directly on tThiS letter. 


ES re See eee ee oe eee ee age es ee Se pee ee gO ES a EE Ge eR SS a SE SRE EE eS SS ea SR  T e e  S ce S 


TABLE I 
COMMAND NAME: NFOIO 
BlLLET SEQUENCE CODE: .? 
Poreet TITLE.) PANEL HDeSOV COMM CONTROL SOY OCESURY 
RESPONDENT'S RANK: LIEUTENANT COMMANDER 
KRESPORODENT*SSAGES 32 
RESPOWDENT*'S DESIGNATOR HISTORY: 1630 1105 
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BELL r SUBSPECTALTY CODE: ? 

PeSrONDE NTE S SUBSPECIALUY CODE: 7? 

EDUCATIONAL LEVEL: POSTGRADUATE STUDIES 

TRAINING USED IN THIS BILLET: NONE LISTED 

FIRST INTELLIGENCE BILLET? NO 

YEARS PREVIOUS INTELLIGENCE EXPERIENCE: 0O4 

montHs IN THIS BILLET: O07 

: _ in the first column below is our original list of 
intelligence outputs. aS _you remember we asked you to 
indicate the percentage of time which you devote to each of 
these outputs. The following data were compiled from the 


information provided ei the 321. respondents Oo the “first 

questionnaire. In the second ,column of TABLE II is the 

percentage of respondents who indicated that the output was 

applicable to their jobs. The third columa contains the 

Wemmepercentage Of tine engaged in that output by those 

considering he output ape ee bee Phe LOourthn column gilises 
S 


your responses to the fir questionnaire. 


ee ee ee ee ee 


TABLE If 
PERCENT MEAN FOR 
THOSE BILLETS 
ORIGINAL LIST OF OUTPUTS Ourbur page ee? iRSBonsE 
OQUTPUT 
1. Administration of 

Intelligence Office 85% 22% 005% 
2. Briefs and Debriefs 78% 9% 020% 
3. Budgets and Budgeting 54% 6% ; 001% 
4“. Charts/Audio/Visual Aids 50% 5% 005% 
5. Counterintelligence 

Studies 16% 5% ~% 
6. Data Analysis 59% 15% 038% 
7. Decisions and 

Recommendations 86% 17% 010% 
8. Estimates 45% 9% 010% 
9. Intelligence Annexes 

to OFORDS 26% 5% —* 
10. Intelligence 

Collection Plans 35% 6% = 


11. Intelligence Collection 
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Tasking 43% 7% 001% 


12. Intelligence Information 


Reports 37% 7h ~h 
13. Intelligence Studies 53% 10% 005% 
14. Interface with ADP/ 

Telecommunications 53% 12% 003% 
wom Orders Of Battle 30% 3% ie 
16. Physical Security 54% 4% . 001% 
lige Tactical Plots 23% 5% -% 

In light of the responses to our. first 
guestionnaire and the interviews, we have modified the 
Output list mitwecawt Ly. Wieing this revised listaor 
outputs Leleee please provide revised percentages in the 


Spaces provided. 


Careful consideration has been given to the need 
POL classifying yous _tesponse and the aggregate data which 
week, result. The pO auvoived in this guestronnaire 
are deemed sufficient general in nature to preclude. the 
necessity for euecs ying your answers. If ou judge 
ee tS ee then follow standard procedures in assi ying 
and returning the uestionnaire. Please return his 
questionnaire in the attached seif-addressed envelope. 
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20. 


TABLE III 


Revised 


New list Of Outputs 


Administration of Intelligence Office 
Resource/Organizational Management 
Budgeting and Fiscal Planning 
Decisions and Recommendations 

Briefs and Debriefs 

Liaison 

Charts and Audio-Visual Aids 
Counterintelligence Studies 

Data Analysis 

Estimates 

Intelligence Annexes to OPORDS 
Intelligence Collection Plans 
Intelligence Collection Tasking 
Intelligence Information Reports 
Interface with ADP/Telecommunications 
Orders of Battle 

Physical Security 

Tactical Plots 

Non-Intelligence Related Outputs 


Counseling/Training 


Percentages 


eee 


a nt ms a ee ee ree 
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APPENDIX C 


USER'S MANUAL AND TPS GUIDE 


The complete INTELL data file is permanently retained on 
tape storage. This file was created by SPSS's "SAVE FILE" 
instruction. Additionally, the original INTELL data declara- 
tion statements and the QID12CDS files (from which the INTELL 
file was created) each were stored on punched cards for 
secondary back-up. .Both card files and the tape file were 
placed in the custody of the Naval Intelligence Curricular 
Officer (Code 382), Naval Postgraduate School, Monterey, 
California 93940. 

The SPSS declaration cards file was approximately 960 cards 
and included all format statements, missing value statements, 
variable labels, and value labels, etc. The declaration state- 
ments are essentially those listed in Appendix F Sample O [only 
a few cosmetic changes and the change in the file name from 
INTELLD to INTELL differ]. The QID12CDS was the sequential 
file of twelve cards for each of the 325 cases [3900 cards 
total] which contained the August 1974 questionnaire and 
DELPHI "Al" [first seven cards], the September interview data 
{next two cards], the November DELPHI "A2" data [next card], 
and the December DELPHI "B" data [last two cards]. The 
QID12CDS file is listed in Appendix H. 

Occasional access to this data, when authorized, would 


best be by use of the tape file. More frequent access would 
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be expedited by transfering that file to disk storage, space 
permitting. Nominal core storage requirements for this SPSS 
file was 204K bytes. At best, this core storage requirement 
allowed "CLASS F" execution priority. 

The remainder of this appendix documents those steps 
required to: (1) retrieve the variable labels and the value 
label information from the SPSS file, (2) access the existing 
INTELL data base file from tape storage, (3) transfer the 
data file from tape storage to disk storage, and (4) regener- 
ate the INTELL data file on tape or disk storage from the 
QID12CDS file. These instructions are necessarily limited in 
Scope to an outline of the basic steps required to accomplish 
the above four functions, and apply specifically to the 
computer center at the Naval Postgraduate School. Additionally, 
a deScription of the TEXT PROCESSING SYSTEM has been included, 


as "TPS" played an important part in the project computerization. 


1. To retrieve the variable labels and value label data. 

Two methods may be employed to acquire a complete list of 
the variables declared in the SPSS file. The INTELL data tape 
must be checked-in at the dispatch desk in the computer center 
prior to executing these programs in order to retrieve this 
information. 

The first method produces the more readable Sequential 
list of variable numbers with only the variable description 
printed in the format very similar to those cards used in the 


SPSS "VAR LABELS" statement. The "DUMP" control card is used 
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to print this information which was recorded in the "DOCUMENT" 
file on the data tape fone of the cosmetic changes made in 

the last data set]. The following JCL and SPSS control cards 
will produce this listing: 

//---STANDARD JOB CARD HERE--- 

MeexeEC SPSS5REGLON=250K 

//FTO3FOOL .DD UNIT=2400,DISP={OLDiKEEP}4,VOL=SER=INTELL. 

// DSNAME=INTELLILABEL={1,8L}4DCB=DLKSIZE=201e 


Z7SYSIN DD x 


Gey FILE ENTECE 
DUMP DOCUMENT 
FINISH 

/x 


Tne second method also uses the SFSS "DUMP" control 
statement, but provides the sequential variable labels with 
"VALUE LABELS" information interspersed with each variable 
Geclaration, The following JCL and SPSS control cards will 
produce such a listing: 

//---STANDARD JOB CARD HERE--- 

// EXEC SPSS,REGION=250K 

//FTO3ZFCOL DD UNIT=2400,DISP={OLD,KEEP} .VOL=SER=INTELL, 
ae SHANE-INTELLZEABEL={i5SL1}.DGB=BLKSIZE=e01e 


//SYSIN DD * 


GET FILE Ticats 
DUMP IPABELS 
FINISH 

/x 
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2. Accessing the INTELL tape file. 

The following JCL 06 SPSS control cards in general access 
the INTELL data file from tape storage. Once the file has 
been retrieved by the "GET FILE" control statement, any valid 
SPSS control statement(s) may be executed. 

//---STANDARD JOB CARD HERE--- 

77 EXEC SPSSGREGION=2SO0K 

//FTO3FOOL DD UNIT=24004,DISP={OLD.KEEP} .VOL=SER=INTELL, 
// DSNAME=INTELLiLABEL={14SL}.4.DCB=BLKSIZE=201e 

//SYSIN DD * 

RUN NAME ANY TITLE DESIRED 

GET FILE TPZ 

any standard SPSS control statement (s) go here 

FINISH 


1% 


3. Tape to disk data file transfer. 

The following JCL and SPSS control cards allow access to 
the existing data file from tape storage and define an output 
file on the public disk which has been name "MARY". The pro- 
grammer must check with the dispatch clerk prior to executing 
this program to verify that sufficient steerage space exists 
on the disk unit selected. SPSS data storage procedures are 


used to "SAVE FILE", 





//~---STANDARD JOB CARD HERE--- 

// EXEC SPSS.,REGION=cSO0K 

//FTO3SFOOL DD UNIT=2400,DISP={0LD,KEEP},VOL=SER=INTELL. 
// YSNAME=INTELLsLABEL={14SL}4,DCB=BLKSIZE=e01e 
//FTOYFOGL DD UNTT=23L4.VOL=SER=MARY sDSNAME=INTELL 

// LABEL=RETPD=30,DCB=BLKSIZE=3624.,DISP={NEW.1KEEP} 4 

// SPACE={TRK 1160.53 5RLSE} 

//SYSIN DD * 

RUN NAME Ait 2) eee eES PRED 

Get FILE Chit ele 

at least one valid executable SPSS control statement must be 
included here (a CONDESCRIPTIVE is used as an example): 


CONDESCRIPTIVE VAROOS 


STATISTICS ALL 
FILE NAME TNTEGE 
SAVE FILE 

FINISH 

1x 


In addition to verifying the existence of sufficient disk 
storage space on the unite desired, the programmer should also 
insure that the label “INTELL" which was used in the FTO4F001 
Gata definition statement is acceptable at the computer center. 
There are file naming conventions which may apply to this 


new data Set. 
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4. Regeneration of the INTELL data set. 

Assuming that there may exist a future need to recreate 
the INTELL tape file or to create another storage device file 
directly from the SPSS and raw data card files, the necessary 
data files were arranged to allow such a geneneration process. 
In addition to the following JCL cards, the SPSS declaration 
deck [approximately 960 cards] and the raw data deck [the 
QID12CDS file of 3900 cards] are required. The programmer 
should check with the dispatch clerk in the computer center 
concerning the availability of storage space on any of the 
mass storage units. It should be noted that the Model 2321 
Data Cell cannot be used because of the requisite block size 
used in SPSS files. 

Two different JCL card sets are listed. The first deck 
should be used to recreate the INTELL file on tape storage. 
The second JCL deck should be used to create the INTELL file 


on disk. 


(7=--Si1ANDARD JOB CARD HERE---.,TINE=4 

77 EXEC SPSSiREGION=eS0K 

//FTOUFOOL DD UNIT=2400.DISP={NEW .KEEP} .VOL=SER=INTELL 

fee y SNAMVE=INTELLGLABEL={14SL},DCB=BLKSIZE=e0ie 

//SYSIN DD * 

The SPSS deciaration ance up to and including the "READ INPUT 
DATA" control statement goes here. 


READ INPUT DATA 
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The QID12CDS card file [the 3900 cards for input data] goes 
here. 

SAVE FILE 

FINISH 

/x 


or for storage on the 2314 disk named "MARY": 


7/---STANDARD JOB CARD HERE---,TIME=4 

// EXEC SPSS.,REGION=250K 

//FTOUFOOL DD UNIT=23L4,DISP={NEW.KEEP} .VOL=SER=MARY 4 

// DSNAME=INTELL sLABEL=RETPD=30,DCB=BLKSIZE=3b24, 

// SPACE={TRKif160,5},RLSE} 

//SYSIN DD * 

The SPSS declaration deck up to and including the “READ INPUT 
DATA" control statement goes here. 

READ INPUT DATA 

The QID12CDS card file [the 3900 cards for input data] goes 
here. 

SAve FILE 

FINISH 

/x 
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EPS, A OLEXT PROCESSING SYSTEN 


TPS attempts to provide a readily available text 
processing system which is efficient to use, in terms of 
both the preparation of input and the computer resources 


demanded. This document was prepared with the aid of TPS. 


TPS is a program which runs on the IBM 360 under the 
OS/MVT operating system. IPS provides the user with a great 
variety of commands which allow total control over text 
placement on the output page, as well as many services which 
aid the user in the preparation of indices, tables, 


indentation level control, equations, etc. 


See ee a ee ee we ee 


In its simplest form, TPS requires user knowledge of 


three "commands": 


-PG Print the rest of the current line buffer and skip to 


cue COP Of thie next page. 


-PP Print the current Line buffer and begin a new 


paragraph, skipping and indenting. 


a "Capitalize" the letter which follows. 


Let us consider a simple example of keypunched input 
Which illustrates these rules: 
SIO CIC CO IOI IO I ICICI GIO IC ici aca ake ak fc af ak ak ak akc ak aie ak ak ak 
moOsP PZ IRIS 25 A SIMPLE EXAMPLE OF 
COMMAND USAGE IN /T/P/S. 7IT WILL RESUIT 
IN THE TWO PARAGRAPHS WHICH FOLLOW. 
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-~PP/A NEW PARAGRAPH FOR THE EXAMPLE. 


This is a simple exanple of command usage in TPS. Tt 


will result in the two paragraphs which follow. 


A new paragraph for the example. 


IO ROR GRR IO RIO IO Fok RK gO kak R diogok gok ida kk kok ak 


Example 1 


In Example 1, the card input did not fill all 80 
columns of the card. Note that all the blanks between the 
last word of card 1 (OF) and the first word of card 2 
(COMMAND) have been conpressed to a single Space in the 
output. This "blank squeezing" will always occur unless 


commands are given to Suppress it. 


Since few keypunchers (or typists, for that matter) can 
produce perfect output, a correction feature is provided in 
TPS. It gives you a Simple way to correct errors as you 
punch cards. It won't solve all your problems, but it can 
save you a lot of card duplication. If you discover that 
you have made an error, you can delete characters in error 
by punching the "¢" character. Thus AMZND is equivalent to 
AND, and TJIS¢¢¢HAT is THAT. You may not use the "¢" to 


correct errors on the previous card, however. 


You have probably been wondering how ts get upper and 
lower case output. To do so requires a special print train 
(the TN train) to be installed in one of the high-speed line 
printers. This interrupts normal service, and is therefore 
generally available only once per day (in the very early 
morning). Two output classes have been established for TN 
output: SYSOUT=M is printed on regular lined paper and 
SYSOUT=N is printed on unlined bond. 
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Since the TN train has numerous "special" characters 
for which the keypunch has no’ keys, their use is made 
possible by "capitalizing" available characters, 2.g., /+ is 
+ and /= is #. A List of the upper/lower case character 
relations is given below. 

ABCDEPGHIJKLNYNOPQRSTUVWXYZ0123456789 
abcdefghijklmnopqrstuvwxyz012 3456789 
nd -e-9%n (/t L) +-4} <2>,[-]#!1( UPPER CASE 
#,5.-ODKR*</t+_) Z[E>232°?"=!1( lower case 


A typical user produces several draft versions of his 
document before the final copy is ready. These draft 
versions of TPS output may be printed with the normal 
printer (PN train, SYSOUT=A) for draft review. You can 
proofread your text without waiting for the overnight 


turnaround of the TN output. 


Running TPS 


ae ae ee Se =— = 


To run TPS, the following JCL is needed: 
Vee eee Gh = TS 
//STEPLIB DD DSN=F0132.L,DISP=SHR, UNI T=2314, VOL=SER=LINDA 
//SXYSPRINT DD SYSOUT=A 
7/SYSIN DD * 
This deck will produce upper case debug output. All 
characters will be single struck. After the content and 
general form of your text appear to be satisfactory, 
additional proofing facilities can be obtained by specifying 
// EXEC PGM=TPS, PARM='D!° 
when running TPS. This will cause TPS to overstrike capital 
letters, while lower case letters will be single struck. 
Note that overstriking causes three times aS much work for 


the printer, sincs each line must be printed three times. 


If upper/lower case output is required, then use: 
// EXEC PGH=TPS, PARM="TNP 
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and change the output class to 

J/STSPRINT DD SYSOUT=M 

for output on lined printer paper; or, 

/J/SYSPRINT DD SYSOUTEN 

for output on bond paper. Note that bond output should be 
used only for the final run since it is considerably nore 


expensive than regular printer paper. 


The normal keypunching servies of the W. R. Church Computer 
Center are available for TPS users. Please note, however, 
that keypunch jobs must consist of 40 or fewer pages of 
text. Standard first in, first out service will be given to 
a user's first TPS keypunch job submitted each day; 
time-available punching will be done on any TPS keypunch 
requests in excess of the 40 page limit. No priority 


keypunching service is available for TPS users. 


TPS provides control over many different aspects of 
text placement. Expressed in general categories, they are: 
line control: centering and justification 
margin cortrol: indentation, left and right margins 
dump and skip: line dump, paragraphing, paging, skips 
page numbering: mode and location of page numbers 
revision flagging: documentation aids 
indexing: index and table of contents generation 
formulas: superscript and subscript aids 
macros: textual substitution with parameters 
debugging: TPS aids 
basic functions: connands having local effect 
global control: global functions 
Command definitions have been grouped according to the above 
divisions. An alphabetical listing of commands is given in 
the Index. 
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Default values of control settings are shown in 


Appendix I. Additional PARM values are defined in Appendix 


If. 


~CN 


Eu 


-LJ 


~RJ 


Pete CC CCCLCSCSS SCC CSCS SSCL OSS SSCS Se SS Se Ss 


line control 
CPC eT CCe CeCe SS SS SSCL SSS SS eT eee ee Se ee Se ee 


Line control action is initiated at the time the line 
buffer is dumped. Thus, only the last line control 


command given is followed. 


CeNter lines 

Center between the right and left margin all lines 
printed after the execution of this command including 
any lines in an incomplete state. The margins used are 
those which were set at the time the lines group in 
progress was begun. Centering assumes that the line 


initially started at the left margin. 


Even Margins 

Simultaneously right and left justify, by inserting 
extra blanks between words, all text found between the 
right and left margins. The direction oF blank 
insertions is switched before each line is generated to 
balance the overall page print density. Text not 
between the left and right margins is unaffected by 
justification. 


Left Justify 

Left justify all line groups (lines are left unchanged 
in the line group buffers). Before special 
justification techniques are applied all lines have 


this format before printing. 


Right Justify 
Right justify all Lines following the execution of this 
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command. 
fok kK dc dok & koko ak kok fok dak gok kk kok Rok dotokoak kkk ak 


margin control 
FORGO EI OHO IC oi i ici ak ict 


Three commands are provided for setting margins. The 
number which is a part of each command refers to the 
position in the print line: 001 is the leftmost print 
position; 132 is the rightmost. Default values for 


these parameters are shown in Appendix I. 


-ISnnn Indentation Set 
Set the paragraph indentation to "nnn". If it is equal 
to the left margin, one blank line is inserted before a 
paragraph conforming to standard block paragraphing 


conventions. 


~LMnnn Left Margin set 
Set the left margin to "nnn". This is not in effect 


until the current line group is dumped. 


-RMnnn Right Margin set 
Set the right margin to "nnn". As in -LM this command 
is not in effect until the current line group is 
dumped. 


3K A AK OK ok ake 2 26 a eo ae oe kK 2 ae ek a ac eo a ake ke ok aK KK ke ak ok 


dumo and skip 
ROO I OK IC RI tok do Rk kok tok ko ak tak 


TPS produces up to 5 line buffers for each printed 
line. These are collectively known as the Line group, 
and consist of the main line and optionally the 
overprint, the bold face, the superscript, and the 
subscript lines. The printing (dumping) of the line 
group is implicitly forced whenever the accumulated 
text in the buffer extends beyond the right margin. 


Explicit control of dumping and skipping is obtained 
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~DB 


=PG 


with the following commands. 


Dump line group Buffer 

Dump all text found in the line buffers observing all 
line justification conventions, with the exception of 
even margins; normal carriage control is taken. If the 
line buffers are empty, no print action is taken. the 
line output pointer is subsequently set to the left 


margin constant. 


Dump buffer allowing Even margins 

Dump all text found in the line buffers in exactly the 
Same manner as the -DB except that the Even Margin 
option, if set, is observed. This command might be 
useful if an absolute tab or new paragraph command was 
used for setting up marginal notes while text between 
the margins is required to be right and left justified 


in order to blend with the rest of the text. 


New PaGe 

Dump the last line group, start a new page, and 
establish a new header displacement. fop of page 
numbering, if reguested, is performed automatically. 


No action is taken if already at top of page. 


New ParagraPh 

Dump the line buffers as in a -DB. The output position 
is set to the paragraph indentation constant. If the 
paragraph indentation is equal to the left margin or if 
-CCO (Single space, special option) has been specified, 


an extra normal carriage control is performed. 


-PSnnn Conditional Page Skip 


Dump the current line buffer and then skip to the next 
page if "nnn" times the current carriage control value 
(i.e., nnn*2 if -CC2 ) LINES ARE NOT AVAILABLE. ON THE 
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CURRENT PAGE. 


-SKnnn SKip lines over page boundaries 
Dump the line buffers, including carriage control, and 


insert "nnn" lines without regard to page boundaries. 


-SPnnn Skip lines or new Page 

Dump Jine buffers including carriage control and insert 
‘nnn lines. If the skip goes over a page boundary 
skipping stops at the top of the next page after header 
spacing. 

FCI III IO OI BO ICR Iai tok atokok tok akc 

page numbering 
Boo ok ook ak ik tok foo ick tok i tok 


Page numbers are automatically generated and printed at 
the bottom of each standard page (see -PB). If bottom 
numbering is not desired, other forms may be selected 


from the following list. 


-ALnnn Absolute Left Margin 
Set the absolute left margin to value "nnn". The 
absolute margins are used to compute page number 


locations. 


-ARnnn Absolute Right margin 
Define the right absolute margin for page numbering. 
It's initial value is equal to the default right 


margin. See also -AL. 


-~PBnnn Page number at the Bottom of the page 
Generate the page number "nnn" centered between the 
absolute left and right margins three lines below the 
last printable line on the page as specified by the -BD 


command. See also -PN. 


-PNann top of Page Numbering 
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Generate the current page as "nnn" right justified on 
the first printable line of a page, before header 
spacing is taken. Since TPS generates output one line 
at atime this form of page numbering will not be able 
to set a proper page number until the next page is 
started. Page numbers are incremented automatically. If 
"nnn® is equal to "***" then page numbering will be 


suppressed. 


Pe Page number in Roman 
Generate the current page number as a centered lower 
case Roman number at the bottom of the current page. 
The value of the page number to be used is set with a 
PB or PN command. fhe current page number may be reset 
with a -PB OR -PN COMMAND. 


~P# Print the current page number 
The value of the current page number will be printed 
whenever this command is encountered. Special control 
over page number placement can be achieved by combining 


this command with “ON" conditions. 


-Ptnnn Add "nnn" to the current page number 
The contents of the current page number are incremented 


by "nnn" 


~P-nnn Subtract "nnn" from the current page number 
The contents of the current page number are decremented 
bye !nnn 
BO IO AR IO IR ICICI ISIC IOI IC Ok fake i ge ic ak ak ae 
revision flagging 
BOI IORI OR ROO IO BO HR RC ag at kok i ogok i gc ak ak ak 


These commands provide a mechanism for flagging text 
changes. The revision character is placed on the 
output line 4 spaces to the right of the current 


absolute right margin. 
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-RB Revision Begin 
This command flags the beginning of revised text. All 
text following this conmand will be flagged with the 
current revision Flag ("{" is default) until the -<-RE 


command is encountered. 


~RCa Revision Character set to "a" 


Change the current revision flagging character to "a". 


-RE Revision End 
Signal the end of revised text. 
SOO tk do tok tka Fok ta a 2k ea fa ak ok 
indexing 
BO IO I IOI Ook doi kok kaka ak kak ak ak ak ake akc ak ak ak ake ake ako 


One thousand cells, numbered 000 thru 999 are available 
for index generation and counting. They are 
initialized to a zero value. A warning message is 
issued whenever an attempt is made to store a new value 
into a cell containing a non-zero value, Since cell 
contents may be incremented and decremented, cells 
provide a primitive counting mechanism for use in text 
generation. In addition, cells may be indirectly 
referenced by any command which contains a numeric 
parameter field by replacing the "nnn" with ".nnn"; the 
second form of parameter returns the value which is 
currently stored in cell "nnn" whereas the first 


parameter form returns the value "nnn". 


-A#nnn Print cell value in alphabetic caps 
Alphabetic interpretation of the numeric value of ‘the 
cell will be printed. fhus, a call value of 1 results 
in a "A", and a value of 4 ina "D", Valu2s greater 


than 26 or less than 1 will produce an error message. 


-Bénnn Print cell value in lower case alpha 
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Operation is the same as for A#, except that letters 


are lower case, i.e., 1 is "a" and 4 is "da", 


-C+tnnn Add 1 to the contents of cell "nnn" 
The value currently stored in cell "nnn" is incremented 


by 1 and the result stored in cell "nnn", 


-Génnn Get and print the number in cell "nnn" 
The number stored in cell "nnn" is’ retrieved and 
printed. This command is useful for generation of 
indices or Tables of Contents when used in conjunction 


With the -S# command. 


-Hfnnn Print cell value in superscript numbers 
The cell value is printed as a superscript number. 


Useful for footnotes and reference citations. 


-~IT#nnnvvv Initialize cell "nnn" to value "vvv" 
The unsigned value "vvv" is stored in cell "nnn" for 
later use. The value "vvv" must be terminated with a 
blank 


-NLn Number Length for G# Hi R# Q# 
The value of the cell will be printed right-justified 
in a field of length "n". The default field length is 
2. If the value is longer than the current value on 
n", the the additional places will be printed. 


-Q#nnn Print cell value in lower case Roman 


Same es R#, except numerals are lower case. 


-~R#nnn Get and print the value in cell "nnn" in Roman 
numerals 
The numeric value stored in cell "nnn" is fetched and 


then printed in lower case Roman numerals 
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-St#tnnn Store the value of the current page number in cell 


on" 

The value of the current page number is stored in cell 
"nnn", If cell "nnn" does not have a zero value, then 
an error is indicated. Cells may be zeroad with the 


-Z# command. 


-Z#nnn Zero cell "nnn" 


=ML 


Initialize the indicated cell to a zero value. 
BOCK CIC IGRI dO fo kak ak ak ak ak ak ak 


formulas 
FORK ROR III ERR III RGR GI i i fk kak ak ok ake ak 


Primitive facilities for formula representation are 
provided by the commands of this section. The 
introduction to the -DB command provides background 
information necessary for understanding of the formula 
generation conmands. Note that while superscript and 
subscript lines can be generated, these special lines 
provide none of the features necessary cr making 
composite characters {i.e., overprint, underline) ; 
neither are there facilities for generating super or 
subscripts on super or subscript Lines. When complex 
positioning of arguments is required, use of absolute 
tabs (-AT) and. single spaced lines (-CC1) is 


recommended. 


Return to current relative position in the Main Line 

Output all the following text on the main line starting 
at a point immediately following the last character 
generated. This is a possible termination for the -SU, 


-SB, or -OP commands. See also -MX. 


Return to last main line position used 
Place all text following this command on the main line, 
starting after the last used position in the main line. 


See also -ML. 
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-NS 


= Si8) 


= SU 


No Sub or superscripting 

Turn off super-subscript mode. Be sure that the line 
buffers are completely empty before issuing this 
command or incompletely generated subscript and 


superscript lines will not be printed. 


Start suBscript 
Save the location of the line output pointer and insert 


text in the Subscript line. See also -SU. 


“Start sUperscript 


Save the line output pointer and insert all text in the 
superscript line. This mode may be suppressed by an -SB 
or -NS. 

Pott SCP Te LLC Le Cee eCecL LCL eLee ee eee? 2. ee 


RaACIOS 
He Fe ee He a a a ee ok ig oe He ok oe 2g 2 oie oo ok he oe ke ook ee OK ok ok fe 


The TPS macro facility provides a mechanism for 
shorthand representation of text phrases (or tabular 
formats, etc.) which are frequently used. TPS macros 
may have an arbitrary number of arguments (zero or 
more). To use a macro, it must first be defined; a 
prototype macro definition is: 
~MDac. Macro body. ..- "Mra 

where "a" ais the macro name and "...macro body..." 
represents the sequence of commands and text which are 
to be executed whenever the macro is invoked (used). 
The macro body may contain any TPS command; except for 
the -NC, these commands are not executed at definition 


time. 


To use a previously defined macro, we command “@da" (or 
“-MUa"). This causes TPS to read new text from the 
macro body rather than the normal input stream. Input 


text is taken from the macro body until one of the 
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following conditions occurs: 

(a) all text in the macro body has been processed. 
Action: Return to the invoking text stream. 

(b) a macro invocation is required by the macro hody 
Peet. 
Action: Invoke the reguested macro. Note: the 
requested macro must not be the macro you are currently 
executing. 
(c) a request for reversion to the invoker's input 
stream is encountered (-MR or !). 
Action: Pevert to the invoking text stream, processing 
the text until a -MR or ! command is encountered. 
Return to the macro body and process the remaining 
text. 
Note that the ! may be used in place of the "nnn" 
command argument within a macro body; when this occurs, 
the parameter value is obtained from the invoking text 
stream. Reading of the invoking text stream continues 
until a matching ! is encountered. 
(d) a request for reversion to the master text stream 
is encountered (-4T). 
Action: Revert to the master text stream, processing 
the text until a -MR or ! command is encountered. 
Return to the macro body and process the remaining 
text. 


Example:-MNDE/ELECTROMAGNETIC /COMPATABILITY-MDE Definition 


OEVGCONSTDERATIONS ... Use 

The macro named "E" is invoked whenever the phrase 

"Electromagnetic Compatability" is required in the 
text. 

Exanple2:=MDz i-ATOSO!-ATOUO!I-ATOSO!-ME: Definition 

OevOrestost is iaes2!'13! 2113! Use 

The macro named ":" Gis defined in order to make a 


table with three columns of numbers; these columns 
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ih Gs 


-~MDa 


-MFa 


-MOa 


begin respectively at column 30,40, and 50. The macro 
";" is purged (~MP:) so that the same name may be 


reused whenever a new table definition is needed. 


Three macros have been predefined; they are: 
~MD1-PG-SK004-=L-CN-MR--~L-S KO0Q2-EM-ME1 
-MD2-SK002-PS010-=L-M&R-~L-SKO001-ME2 
=MD3—sh001—=-PS010-UN-MR=NU-SKOO]—MES 

They are intended to be used for 
(1) ci 222 your chavter title... ! 
(2 a2 ...your major heading...! 


(330s .-.your sub heading...! 


Macro directory Clear 
Clear all macro descriptions enabling new ones to be 


specified. 


Macro Definition 
Define the start and name cf a new wacro. All 
instructions and text following this instruction, until 


an ~MEa command, are stored as a macro named "al", 


Macro definition End 
Terminate the scope of an -MDa command. this command 
must be preceded by an -MDa command or an invalid 


command message will be issued. 


Macro oFf 

Declare macro "a" to be temporarily non-existent. This 
command can be nullified by the -MOa command or by 
re-defining the macro. The macro itseif is not changed 


by this command. 
Macro On 


Declare a macro as existing after a -MFa has been 


issued. This function is performed automatically by an 
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-~MPa 


~MR 


~MDa. 


Purge Racro a" 

Remove the macro definition for macro "a" from storage. 
This command is required whenever a redefinition of 
macro "a" ais made which lengthens the original macro 
body; shorter redefinitions of macro "a" are allowed 


without use of the "purge" command. 


Macro Revert to the last used input stream 

Permit a macro to release control to the card reader 
input stream and obtain control again. This is used to 
supply parameters td a macro. A shortened form of the 


-MR command is the "i", 


“MT Revert to the Text stream for next argument 


-~MUa 


Macros which wish to retrieve their arguments from the 
input text stream rather than the next higher macro 
becy Mevet Wrist “se the -MY command rather then the —™2 
command which only fetches the argument from the 


immediately calling macro body. 


Use a previously defined Macro 
Insert all the text in macro "a" into the input stream 
at this point. A shortened form of the -MUa command is 
Pew ad. 


CIO GIO ICR CE IS ik a OK GR RIO ak akc 


special macros: the ON condition 
ASCO IO IOC roa ik cook ack toi date de 


Heading and footing text can be automatically printed 
at the top and botton of each page through the use’ of 
special parameterless macros called “ON" condition 
macros (after PL/I). For an “ON" condition macro to be 
invoked, it must be defined and explicitly enabled. 
The ~PG command should not be used in these macros. 


The last command of the ON macro must be a dump (-DB) 
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or a skip (-SKnnn). 


-ODn Define "On" condition macro 
For "n"=1, a macro which is invoked whenever the top of 
the page is encountered is defined. Eom “n'=25 4 
bottom of page macro is defined. These macros can have 


no text stream arguments. 


-OFn Disable (off) the "n" "ON" condition 


The indicated heading or footing macros are turned off. 


soon Siable "ON" condition "n" 
The indicated "ON" condition is enabled. Whenever the 
top or bottom of page is encountered, the appropriate 
macro will be invoked. 
RIOR I IO IOI III IGG i lok kaka ak kak ak 
debugging 
A CG CO ok IIa i rok tak ak tok foto ak aie ak 


TPS is a programming language and your text program 
will probably contain some errors. Most errors can be 
found with only the -=C option; Most errors can be 
found with only the -=C ~TION; THE NORE MYSTERIOUS THE 
ERROR, THE MORE INFORMATION YOU WILL WANT. 


-=C Command summary print 
Print a summary of each command encountered. This is a 
useful debugging aid which still enables utilization of 


the resultant output. 


-~C No Command summary (default) 


Do not print the command summary. 
-=I Intersperse source cards 


This is the most detailed level of debugging printout. 


The resulting text output is unusable. 
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-~I No interspersed listing (default) 


Do not print source card images. 


-=S Print sequence numbers 
The text in columns 73-80 is printed as sequence 
numbers. You should give the -SLO72 command or use the 
SM=(1,72) parameter on the EXEC card. 


OO I AI Rik kkk kaiaak ak ak akoatete teak ak akc ake fe ak 


basic functions 
SO Ror ak ak kak Rk a aR Ka aa aR ake ae ake ake oki ake ake ake ake ake ake ake akc ake a ake ake a ake ake a 


-ATnnn Absolute Tab 
Set the line location pointer to "nnn". No position 
testing is performed allowing text to be placed 


anywhere in the 132 positions available per line. 


-BF Bold Face font 
Over strike all non-blank characters in the main line 
following this command. This implementation over 


strikes three times. 


-BSnnn Back Space 
Backspace the line output pointer "nnn" positions. If 
the left margin is exceeded the line output pointer is 


set to the current value of the left margin. 


-FMnna Fill with "a", leaving a right margin of "nn" 
When this command is encountered, the character "a" is 
printed until the line is filled, with a right margin 
of "nn" remaining. It is useful for Index and Table of 


Contents work. 


~-FWnna Fill With "nn ttatts 


Exactly "nn" "atts will be be printed. 


-LC Lower Case 
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=NC 


=NF 


-NU 


sO 


Convert to lower case all text following this command 
before printing. Yfhis is used to terminate an -UC 


command. 


Read the Next Card immediately 
Whenever this command is encountered, the balance of 
the card is considered to be commentary, and the next 


card is read. 


Normal Face font 
Resume normal single strike printing of the main line. 
This nullifies the effect of -BF. 


No Underlining 


Terminate underlining. 


OverPrint 
Save the location of the line output pointer and insert 


text in the overprint line. See also -ML AND -MX. 


~SSnnn Skip Spaces 


=TB 


~UC 


-UN 


Add "nnn to the current value of the line output 
pointer. If the resulting location is greater than the 
right margin then the line output pointer is set equal 


to the right margin. 


TaB (relative) 
Set the line output pointer to the first value saved in 
the relative tab table that is greater than the current 


value of the line output pointer. 
UpperCase 
Convert all characters following this command to upper 


case before processing. -LC will reset lower case mode. 


Start UNderlining 
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-|* 


~% | 


ah fi 


Underline all non-blank characters placed in the main 


line following this command. 


As is text 

Dump the following text with blanks unsuppressed, 
returning to normal mode when the next control command 
is encountered (any control command). Note that even 
margin (~EM} requirenents override this command. See 
the -TR command for a discussion of techniques for 


representing "significant blanks." 


Hutputethesciaracter =" 


Print the current attention character. 


Start comment. 
Text following this command is not printed and the line 
output pointer remains unchanged. All commands except 


the ~*] will not be executed. 


End comment. 
Resume normal un-conmented text processing. 


Leave input unchanged 
No translation of input is preformed; this is useful 
when card images or quantities of text in upper case- 


with special symbols are required. 


Normal translation of input (default) 


Normal translation of the input stream is carried out. 


fa Change print case 


If TPS is in upper case mode the character "a" is made 
lower case. If in lower case mode the character is made 


upper case. 


// Output the character / 
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Pee Se CC SPSS SSCS SS SSCS SCS CSS CSC LSS OCS LL SS So 


global control 
FO CI IIR II I Ra IR Rok Fg ke a 283K 


The collection of parameters which specifies the global 
control values is known as a program status group 
(PSG). The control values specified in the PSG may be 
saved and subsequently restored to one of several 
PSG's; thus, context switching can be done efficiently 
and concisely by means of PSG saves and restores. The 


control values in the PSG are listed in Appendix I. 


-BDnnn Body length Definition 


-CAX 


-CCn 


Set the total number of lines on a page less 3 (the 
usual paper setting in the printer is three lines from 
the top), starting from the top of the page. If the 
length of the page set is greater or equal to the 
current line number then a new page is started after 
the line group currently being generated is completed. 


I£€ nnn is *** pagination is suppressed. 


Change the Attention character 

Change the attention character (default "-") to the 
Single character specified. A case change qualification 
is not accepted in this special case and the use of the 
case changed alternate for this character is lost. 


Automatic Carriage Control 
Insert n-1 blank lines between each line group printed. 
If "n" is equal to 0 then an additional blank line is 
generated between paragraphs. Issuing the command with 
a non-zero "n" resets the inter-PARAGRAPH SPACING. THE 
DEFAULT SELTINGS ARE =~CC2 -CCO. 


~CF Correction Off 


Disable the operation of the correction character (the 


er sy nol). This command does not take effect until 
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the following card is read. 


-CO Correction On 


-CQx 


Turn on the correction feature. The punching of "n" 
consecutive "¢" symbols will cause the "n" preceding 


characters to be deleted. 


Case Qualification character change 

Modify the case change qualifier (default "/"). The 
use of the case changed alternate for this character is 
lost. 


-HDnnn Set the HeaDer spacing 


-ON 


—OY 


-Rn 


Set the total number of lines (less three) to be 
skipped at the top of each new page. Since the IBM 1403 
printer is usually .set to start printing three lines 
from the top of a page these three lines must be taken 
into consideration when setting the header. 


Output is Not printed on the printer 

Do not print any output directed to the printer after 
the execution of this command. A line group in progress 
will therefore not be printed unless it is dumped 


before the command is issued. 


Output is permitted to print 

Restart printer output by cancelling the -ON command. 
The contents of the line group in progress will not be 
printed unless the line group is dumped before printing 


is enabled. 


Reset PSG using reset area n 

Restore all the format description elements described 
in Appendix I to what they were at the time of the last 
“Sn. If the nth reset area has not been set this 
instruction is ignored. "n" must be between 0 and 4. 


257 





-RS ReSet to default PSG (Program Status Group) 
Reset all pertinent overall format variables to the 
original default values. All of them will not be in 
effect until the start of the next line. See also -Rn. 


-SPnnn Set the First input column 
The value "nnn" sets the first column of the input card 
which will be cead. May also be set in the 
PARM="SM=(NNN,MMM)* field of the EXEC card. 


-SLnnn Set Last column of input card 
The last column of the input card which will be read is 


set to "nnn". 


-Sn Save the current PSG in reset area "n" 
Save overall PSG format controls in save area "nt, Wy 


must be between 0 and 4. see also -BRn. 


-** reinitialize TPS 
Reinitialize TPS and begin processing of the text which 
follows. 

“STiiijjj... SetTab list 
Set up to fifteen relative tab positions to the values 
specified. Values should be in ascending order and the 
last value in the list must be followed by at least one 
blank. If the new tab list is shorter than fifteen 
values, only the first replaced tab positions are 
changed. 


-TRab Translate “a to "b" 
Every occurrence of "a" as an output character will he 
changed to "b'" just before printing. The characters 
“a" and "b" may be case qualified. In order to control 


the placement of blanks in the output text, we may 
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-ULa 


choose a character not used in the text and utilize it 
as a filler; subsequent to all justification, this 
"Significant blank" character is translated into a 
normal blank for printing. For example, -TR-~ WILL 
CAGSE EVERY "-~" IN THE CURRENT AND SUBSEQUENT LINE 
GROUPS TO BE PRINTED AS A BLANK. 


Change the UnderLine character 
Replace the underline character with "a". This is 
useful for strike-over and other special effect text. 


The underline character "a" may be upper case (preceded 
by a Ao)" a 


-=B Brief Mode on 


When brief mode is "on", the characters "0" and win 


may be used in place of "-MU" and "-MR" respectively. 


-~B Brief Mode off 


Whenever the characters "0" and "!" are required in the 


text, this command must be issued. 


Initial Program Status Group (PSG) Contents 


Underline character =U 

body length (72 lines) -BD076 

Tab list (15 elements) -$T020025030...090 
Header length -~HDOOY 

Indent =1 S020 

Right margin -RMO75 

Left margin -LM015 

Carriage control -CG2 

Justification -EM 


Value of quantities not in PSG 


Absolute right margin -ARO75 
Absolute left margin -ALO15 
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TPS EXEC card parameters 


Parameters for TPS execution may be specified on 
the EXEC card. The EXEC card is of the form: 
Vf EXEC PGN=TPS, PARM='pl,p2,..6, pk * 
where p1,...,pk are given by one or more of the 


parameters shown below: 


J) upper/lower case printer is desired; must also 
specify //SYSPRINT DD SYSOUT=M OR N. 

SM= (M,N) source margins: begin at "m"3; end at "n" 

COPY=N number of output copies required; n< 4. A 
//SYSUT2 DD SYSOUT=M card is needed if a > 1. 

REPRO copy tile specified by SYSIN to SYSPRINT. Te 


copy option was specified in a previous parm, a 


SYSUT2 file is also required. 


Cc see ~=C COMMAND 
SEQ see -=S COMMAND 
D see -=D COMMAND 
L see -=I COMMAND 
L see -=L COMMAND 
MSIZE=N macro storage area size (default is 4096 bytes). 


Additional copies of this documentation may be obtained by 
running the following program: 

// EXEC PGM=TPS, PARN='REPRO! 

//STEPLIB DD DSN=F0132.L,DISP=SHR, VOL=SER=LINDA, UNIT=2314 
Z7SYSPRINT DD SYSOUT=M 

//SYSIN DD DSN= 2PS.MANUAL, DISP=SHR, VOL=SER=CELO01, UNIT=2321 
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APPENDIX D 
VARIABLE DECLARATIONS 
A. VARIABLE DECLARATIONS FOR THE 
DELPHI A DATA BASE (QCARDS) 

[Some comments have been included where only certain values 

were acceptable for a variable. "cc" refers to card column(s).] 

Card Number One: 

VAROO1; cc 1-25; “COMMAND NAME"; a 25 character alphanumeric 
field with trailing blanks. 

Wen0e2; ce 26-30; “BILLET SEQUENCE CODE"; a five character 
numeric right-justified field with leading zeroes. 

VARO03; cc 31-67; "BILLET TITLE"; a 37 character alphanumeric 
left-justified field with trailing blanks. 

WAROO4; cc 68-72; “UNIT IDENTIFICATION CODE"; a five character 
numeric right-justified field with leading zeroes. 
A list of valid UIC's is given in Table D-1. This 
variable was used to provide addressing labels. 

VARO0O5; cc 73; "“CONUS/OVERSEAS CODE"; a one character numeric 
field. A list of valid continental United States/ 
overseas codes is given in Table D-2. This variable 
described the deployment of the command listed in 
variables VAROO1 and VARO04. 

PeR00G: cc 74-75; “STATE/COUNTRY CODE"; a two character 
alphabetic field. A list of valid state/country 


codes is given in Table D-3. This variable described 


261 





VAROO7; 


VAROO 8; 


VARO09; 


the location of the command listed in variables 
VAROO1 and VAROO4,. Afloat units normally were 1isted 
by their homeport locations. 

cc 76; "CODER NUMBER CODE"; a one character numeric 
field. A list of valid coder number codes is given 
in Table D-4. This variable defined the project 
researcher primarily responsible for the case. 

cc 77-79: "CARD NUMBER ONE SEQUENCE (CASE) NUMBER"; 
a three character numeric right-justified field with 
leading zeroes. This variable differentiated this 
case from all cther caSes within the data base. 

ec 80; "CARD ONE NUMBER"; a one character numeric 
field. The only valid entry for this variable was 


the number 1. 


Card Number Two: 


VARO10; 


VARO11; 


VARO12; 


VAR013; 


cc 1-40; "RESPONDENT'S NAME"; a forty character 
alphabetic left-justified field with trailing blanks. 
cc 41; "RESPONDENT'S RANK"; a one character numeric 
field. A list of valid rank codes is given in Table 
D=-5. 

cc 42-43; "RESPONDENT'S AGE"; a two character numeric 
right-justified field with leading zeroes. If the 
respondent's age were unknown, then a "99" was coded. 
cc 44-47; "RESPONDENT'S PRESENT DESIGNATOR"; a four 
character numeric right-justified field with leading 
zeroes, Civilian respondents, and military respondents 


whose designators were unknown, were coded as "9999", 
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VARO14; 


VAROLS5; 


VARO16; 


VARO17; 


ceyse-sl; "RESPONDENT'S NEXT PREVIOUS DESIGNATOR"; 

a four character numeric right-justified field with 
leading zeroes. Civilian respondents, and military 
respondent whose designator history were unknown, were 
coded as "9999", Military respondents who had only | 
one designator were coded as "0000". 

Ge 52-55; “RESPONDENTS FIRST DESIGNATOR! = a four 
character numeric right~justified field with leading 
zeroes, Civilian respondents, and military respon- 
dents whose designator history were unknown, were 
coded as "9999", Military respondents who had less 
than three designators were coded as "0000". 

cc 56-60; "BILLET SUBSPECIALTY CODE"; a five character 
mixed alphanumeric left-justified field with trailing 
blanks. The first four characters were numeric and 
the fifth character was blank, numeric, or alphabetic. 
If the respondent were civilian, or military and the 
billet subspecialty code were unknown, then this varia- 
ble was coded as "99999", If the respondent were 
military and the billet did not have a subspecialty 
code then this variable was coded as "00000". 

cc 61-65; "RESPONDENT'S SUBSPECIALTY CODE"; a five 
character mixed alphanumeric left-justified field with 
trailing blanks. The first four characters were nu- 
meric and the fifth character was blank, numeric, or 
alphabetic. If the respondent were a civilian, or 


military and his subspecialty code were unknown, then 
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this variable was coded as "99999", If the respondent 
were military and he did not have a subspecialty code 
then this variable was coded as "00000". 

VARO18; cc 65; "RESPONDENT'S EDUCATIONAL LEVEL"; a one 
character numeric field. A list of valid educational 
level codes is provided in Table D-6. 

VARO19; cc 67-71; "RESPONDENT'S TRAINING USED CODE(S)"; a 
five character numeric left-justified field with 
trailing blanks. This variable was the composite of 
up to five different single-character numeric training 
codes (see Table D-7) which the respondent used in 
his billet. Values were coded in any order and the 
absence of any training uSed was coded as five blank 
Gharvacters., 

weed: co 72; "RESPONDENT'S FIRST INTELLIGENCE BILLET CODE": 
a one character numeric field. Only one of three codes 
was acceptable for this variable: "0" indicated that 
the respondent Had had previous intelligence related 
billets, "1" indicated that the respondent had not 
had previous intelligence related tour(s), and "9" 
indicated the respondent's status was unknown. 

VARO21; cc 73-74; “NUMBER YEARS PREVIOUS INTELLIGENCE EXPERIENCE: }; 
a two character numeric right-justified field with 
leading zeroes. Had the respondent had previous 
intelligence related billets, i.e., VARO20 equalled 


"0", then the number of years of previous intelligence 
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related experience was indicated in this field. Had 
the respondent not had previous intelligence related 
billets, or if his statuS were unknown, i.e., VARO20 
equalled "1" or "9", then this variable was coded as 
"99". This variable did not include the amount of 
time spent in the respondent's then present billet. 

VARO22; cc 75-76; “NUMBER OF MONTHS IN PRESENT BILLET"; a 
two character numeric right-justified field with 
leading zeroes. If the number of months the respon- 
dent had spent in his then present billet were unknown, 
then this variable was coded as "99", 

VARO23; cc 77-79; "CARD NUMBER TWO SEQUENCE (CASE) NUMBER"; 
a three character numeric right-justified field with 
leading zeroes. VARO23 equailed VAROO8 in ali cases. 

VARO24; cc 80; "CARD TWO NUMBER": a one character numeric 
field. The only valid entry for this variable was 
the number "2', 

Card Number Three: 

VARO25; cc 1-3; "PERCENTAGE “INTELLIGENCE OFFICE ADMINISTRATION"; 
a three character integer numeric right-justified field 
with leading zeroes. This variable was coded "999" 
if the percentage were unknown. 

VARO26; cc 4; "VALIDITY OF INTELLIGENCE OFFICE ADMINISTRATION"; 

a one character numeric field. Only one of three 

values was coded in this field: "0" indicated that 


intelligence office administration was not a valid 
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VARO27; 


VARO2 8; 


VARO29; 


VARO 30; 


output; "1" indicated that that output was valid; 
"9" indicated that the respondent did not indicate 
his choice concerning the validity of intelligence 
office administration as it pertained to his billet. 
cc 5-7; "PERCENTAGE BRIEFS AND DEBRIEFS"; a three 
character integer numeric right-justified field with 
leading zeroes, This variable was cocee chess Haha 
the percentage were unknown. 

cc 8; "VALIDITY OF BRIEFS AND DEBRIEFS"; a one char- 
acter numeric field. Only one of three values was 
coded in this field: "0" indicated that briefs and 
debriefs were not valid outputs; "1" indicated that 
those outputs were valid; "9" indicated that the 
respondent did not indicate his choice concerning 
the validity of briefs and debriefs as they pertained 
eeehis billet. 

cc 9-11; “PERCENTAGE BUDGETS AND BUDGETING"; a three 
character integer numeric right-justified field with 
leading zeroes. This variable was coded "999" if 
the percentage were unknown. 

cc 12; “VALIDITY OF BUDGETS AND BUDGETING"; a one 
character numeric field. Only one of three values was 
coded in this field: "0" indicated that budgets and 
budgeting were not valid outputs; "1" indicated that 
those outputs were valid; "9" indicated that the 


respondent did not indicate his choice concerning the 
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VARO 31; 


VARO 32; 


VARO 33; 


VARO 34; 


validity of budgets and budgeting as they pertained 
tO his baller. 

cc 13-15; "PERCENTAGE CHARTS AND AUDIO-VISUAL AIDS"; 
a three character integer numeric right-justified 
field with leading zeroes. This variable was coded 
"999" if the percentage were unknown. 

cc 16; "VALIDITY OF CHARTS AND AUDIO-VISUAL AIDS"; 

a one character numeric field. Only one of three 
values was coded in this field: "0" indicated that 
charts and audio-visual aids were not valid outputs; 
"1" indicated that those outputs were valid; "9" 
indicated that the respondent did not indicate his 
choice concerning the validity of charts and audio- 
visual aids as they pertained to his billet. 

ce 17-19; "PERCENTAGE COUNTERINTELLIGENCE STUDIES"; 
a three character integer numeric right-justified 
field with leading zeroes. This variable was coded 
"999" if the percentage were unknown. 

cc 20; "VALIDITY OF COUNTERINTELLIGENCE STUDIES"; 

a one character numeric field. Only one of three 
values was coded in this field: "0" indicated that 
counterintelligence studies was not a valid output; 
"1" indicated that that output was valid; "9" indi- 
cated that the respondent did not indicate his choice 
concerning the validity of counterintelligence studies 


as they pertained to his billet. 
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VARO 35; 


VARO 36; 


VARO 37; 


VARO 38; 


VARO 39; 


cc 21-23; "PERCENTAGE DATA ANALYSIS"; a three char- 
acter integer numeric right-justified field with 
leading zeroes. This variable was coded "999" if 

the percentage were unknown. 

cc 24; "VALIDITY OF DATA ANALYSIS"; a one character 
numeric field. Only one of three values was coded 
ict serleld- ee 0 windleated that data analysis 

as not a valid output; "1" indicated that that output 
was valid; "9" indicated that the respondent did not 
indicate his choice concerning the validity of data 
analysis as it pertained to his billet. 

cc 25-27; "PERCENTAGE DECISIONS AND RECOMMENDATIONS"; 
a three character integer numeric right-justified 
field with leading zeroes. This variable was coded 
"999" if the percentage were unknown. 

cc 28; "VALIDITY OF DECISIONS AND RECOMMENDATIONS": a 
one character numeric field. Only one of three values 
was coded in this field: "0" indicated that decisions 
and recommendations were not valid outputs! "1" 
indicated that those outputs were valid; "9" indica- 
ted that the respondent did not indicate his choice 
concerning the validity of decisions and recommenda- 
tions as they pertained to his billet. 

Cee, 3) PERCENTAGE ESTIMATES’; a three character 
integer numeric right-justified field with leading 
zeroes. This variable was coded "999" if the 


percentage were unknown. 
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VARO40; 


VARO41; 


VARO42; 


VARO43; 


VARO4 4; 


cc.32; “VALIDITY OF ESTIMATES": a one character numeric 
field. Only one of three values was coded in this 
field: "0" indicated that estimates were not a valid 
output; "1" indicated that those outputs were valid; 
"9" indicated that the respondent did not indicate 
his choice concerning the validity of estimates as 
they pertained to his billet. 

cc 33-35; "PERCENTAGE INTELLIGENCE ANNEXES TO OPORDS"; 
a three character integer numeric right-justified 
field with leading zeroes. This variable was coded 
"999" if the percentage were unknown. 

cc 36; “VALIDITY OF INTELLIGENCE ANNEXES TO OPORDS"; 

a one character numeric field. Only one of three 
values was coded in this field: "0" indicated that 
intelligence annexes to operation orders were not 
valid outputs; "1" indicated that those outputs were 
valigss |S Sindicated that the respondent did not 
indicate his choice concerning the validity of 
intelligence annexes to operation orders as they 
pertained to his billet. 

cc 37-39; "PERCENTAGE INTELLIGENCE COLLECTION PLANS"; 
a tnree character integer numeric right-justified field 
with leading zeroes. This variable was coded "ggg" 
if the percentage were unknown. 

cc 40; "VALIDITY OF INTELLIGENCE COLLECTION PLANS"; 


a One character numeric field. Only one of three 
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VARO45; 


VARO4E; 


VARO47; 


VARO48; 


values was coded in this field: "0" indicated that 
intelligence collection plans were not valid outputs; 
"1" indicated that those outputs were valid; "9" 
indicated that the respondent did not indicate his 
choice concerning the validity of intelligence 
collection plans as they pertained to his billet. 

cc 41-43; "PERCENTAGE INTELLIGENCE COLLECTION TASKING"; 
a three character integer numeric right-justified 

field with leading zeroes. This variable was coded 
"999" if the percentage were unknown. 

cc 44; "VALIDITY OF INTELLIGENCE COLLECTION TASKING"; 

a one character numeric field. Only one of three 
values was coded in this field: "0" indicated that 
intelligence collection tasking was not a valid output; 
"1" indicated that that output was valid; "9" indicated 
that the respondent did not indicate his choice con- 
cerning the validity of intelligence collection tasking 
aS it pertained ‘to his billet. 

cc 45-47: "PERCENTAGE INTELLIGENCE INFORMATION REPORTS"; 
a three character integer numeric right-justified field 
with leading zeroes. This variable was coded "999" if 
the percentage were unknown. 

cc 48; "VALIDITY OF INTELLIGENCE INFORMATION REPORTS"; 
a one character numeric field. Only one of three 
values was coded in this field: "0" indicated that 


Intelligence Information Reports were not valid outputs; 
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VARO49; 


VARO50; 


VARO51; 


VARO 52 ; 


"1" indiated that those outputsS were valid; "9" 
indicated that the respondent did not indicate his 
choice concerning the validity of Intelligence 
Information Reports as they pertained to his billet. 
cc 49-51; “PERCENTAGE INTELLIGENCE STUDIES"; a three 
character integer numeric right-justified field with 
leading zeroes. This variable was coded "999" if the 
percentage was unknown. 

cc 52; “VALIDITY OF INTELLIGENCE STUDIES"; a one 
character numeric field. Only one of three values was 
coded in this field: "0" indicated that intelligence 
studies were not valid outputs; "1" indicated that 
those outputs were valid; "9" indicated that the 
respondent did not indicate his choice concerning the 
validity of intelligence studies as they pertained to 
has billet, 

ec 523-55; "PERCENTAGE INTERFACE WITH ADP=—TELECOMMS"; 

a three character integer numeric right-justified 
field with fenagne zeroes. This variable was coded 
"999" if the percentage were unknown. 
cc 56; “VALIDITY OF INTERFACE WITH ADP-TELECOMMS"; a 
one character numeric field. Only one of three values 
was coded in this field: "0" indicated that inter- 
facing with automatic data processing and/or tele- 
communications was not a valid output; "1" 
indicated that output was a valid output; "9" indicated 


that the respondent did not indicate his choice 
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VAR053; 


VARO54; 


VARO55; 


VARO56; 


VARO57; 


concerning the validity of interfacing with automatic 
data processing and/or telecommunications as it per- 
tained to his billet. 

cc 57-59; "PERCENTAGE ORDERS OF BATTLE"; a three 
character integer numeric right~justified field with 
leading zeroes. This variable was coded "999" if 

the percentage were unknown, 

cc 60; "VALIDITY OF ORDERS OF BATTLE"; a one character 
numeric field. Only one of three values was coded in 
this field: "0" indicated that orders-of-battle was 
not a valid output; "1" indicate that that output was 
valid: "9" indicated that the respondent did not indi- 
cate his choice concerning the validity of orders-of- 
battle as it pertained to his billet. 

cc 61-63: "PERCENTAGE PHYSICAL SECURITY"; a three 
character integer numeric right-justified field with 
leading zeroes. This variable was coded "999" if the 
percentage were unknown. 

cc 64; "VALIDITY OF PHYSICAL SECURITY"; a one char- 
acter numeric field. Only one of three values was 
coded in this field: "0" indicated that physical 
security was not a valid output; "1" indicated that 
that output was valid; "9" indicated that the respon- 
dent did not indicate his choice concerning the valid- 
ity of physical security as it pertained to his billet. 
Cepoo7o7;,)" PERCENTAGE TACTICAL PLOTS”; a three character 


iMECt hemes eymigit—justified field with leading 
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VARO58; 


{Note: 


VARO0 59; 


VAROG60; 


zeroes. This variable was coded "999" if the percentage 
were unknown, 

cc 68; "VALIDITY OF TACTICAL PLOTS"; a one character 
numeric field. Only one of three values was coded 

in this field: "0" indicated that tactical plots were 
not valid outputs; "1" indicated that those outputs 
were valid; "9" indicated that the respondent did not 
indicate his choice eee the validity of tactical 
plots as they pertained to his billet. 

card columns 69-76 were unused blanks.] 

cc 77-79; "CARD NUMBER THREE SEQUENCE (CASE) NUMBER"; 

a three character numeric right-justified field with 
leading zeroes. VAR059 equalled VAROO8 and VARO23 in 
all cases. 

cc 80; "CARD THREE NUMBER"; a one character numeric 
field. The only valid entry for this variable was 


the number "3", 


Card Number Four: 


VARO61; 


VAR062; 


cc 1-32; "FIRST ADDITIONAL OUTPUT WORDING"; a 32 
character alphanumeric left-justified field with 
tratling blanks . 

cc 33-35; "FIRST ADDITIONAL OUTPUT CODE"; a three 
character alphabetic left-justified field with 
trailing blanks. This variable was a composite of 
up to three different single-character Aipieeees 


additional output codes listed in Table D~8 used to 
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VARO63; 


VAROGE4; 


VARO65; 


VARO66; 


VAR0 67; 


codify the first additional output. Values were 

coded in any order and the absence of a suitable 
breakdown was coded as three blank characters. 

ce 36-30, “PERCENTAGE TIME DEVOTED TO) FIRST ADDITIONAL 
OUTPUT"; a three character integer numeric right- 
justified field with leading zeroes. "999" was not 

a valid entry for this variable. 

ee 39-70; "SECOND ADDITIONAL OUTPUT WORDING"? a 32 
character alphanumeric left-justified field with 
trailing blanks. 

cc 71-73; "SECOND ADDITIONAL OUTPUT CODE"; a three 
character alphabetic left-justified field with trailing 
blanks. This variable was a composite of up to three 
different single-character alphabetic additional out- 
put codes listed in Table D=8 used to codify the second 
additional output. Values were coded in any order 

and the absence of a Suitable breakdown was coded as 
three blank characters. 

cc 74-76; "PERCENTAGE TIME D&VOTED TO SECOND ADDITIONAL 
OUTPUT"; a three integer numeric right-justified field 
with leading zeroes. "999" was not a valid entry for 
this variable. 

cc 77-79; "CARD NUMBER FOUR SEQUENCE (CASE) NUMBER" ; 

a three character numeric right-justified field with 
leading zeroes. VARO67 equalled VARO08, VARO23, and 


VARO59 in all cases. 
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VARO 68; 


cc 80; "CARD FOUR NUMBER"; a one character numeric 
Gievde Ime only Valid entry for this variable: was 


the number "4", 


Card Number Five: 


VARO69; 


VARO70; 


VARO71; 


VARO72 ; 


VARO 73; 


cc 1-32; "THIRD ADDITONAL OUTPUT WORDING"; a 32 
character alphanumeric left-justified field with 
trailing blanks. 

cc 33-35; "THIRD ADDITIONAL OUTPUT CODE": a three 
character alphabetic left-justified field with trailing 
blanks. This variable was a composite of up to three 
different single-character alphabetic additional output 
codes listed in Table D-8 used to codify the third 
additional output. Values were coded in any order and 
the absence of a suitable breakdown was coded as three 
blank characters. 

cc 36-38; “PERCENTAGE TIME DEVOTED TO THIRD ADDITIONAL 
OUTPUT"; a three character integer numeric right- 
justified field with leading zeroes. "999" was not a 
valid entry for this variable. 

ee 39=70;> "FOURTH ADDITIONAL CUTPUT WORDING": a 32 
character alphanumeric left-justified field with 
tr@iling blanks. 

cc 71-73; “FOURTH ADDITIONAL OUTPUT CODE": a three 
character alphabetic left-justified field with trailing 
blanks. This variable was a composite of up to three 


different single-character alphabetic additional output 
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VARO74; 


VARO75; 


VARO76; 


codes listed in Table D-8 used to codify the fourth 
additional output. Values were coded in any order and 
the absence of a suitable breakdown was coded as three 
Dillankucharacters:, 

cc 74-76; "PERCENTAGE TIME DEVOTED TO FOURTH ADDITIONAL 
OUTPUT"; a three character integer numeric right- 
justified field with leading zeroes. "999" was not a 
valid entry for this variable. 

cc 77-79; “CARD NUMBER FIVE SEQUENCE (CASE) NUMBER"; 

a three character numeric right-justified field with 
leading zeroes. VARO75 equalled VAROO8, VARO23, 
VARO59, and VARO67 in all cases. 

cc 80; "CARD FIVE NUMBER"; a one character numeric 
field. The only valid entry for this variable was the 


number "5", 


Card Number Six: 


Mano? 7; 


VARO78; 


cc 1-32; "FIFTH ADDITIONAL OUTPUT WORDING"; a 32 
character alphanumeric left-justified field with 

fig te iG) ements 

ec 33—-35-) (FIFTH ADDITIONAL OUTPUT CODE™> a three 
character aiphabetic left-justified field with 
trailing blanks. This variable was a composite of up 
to three different single-character alphabetic 
additional output codes listed in Table D-8 used to 
codify the fifth additional output. Values were coded 
in any order and the absence of a suitable breakdown 


was coded as three blank characters. 
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VARO79; 


VARO80; 


[Note: 


VARO 81; 


VARO 82; 


cc 36-38; "PERCENTAGE TIME DEVOTED TO FIFTH ADDITIONAL 
OUTPUT"; a three character integer numeric right- 
justified field with leading zeroes. "999" was not a 
valid entry for this variable. 

cc 39-41; "PERCENTAGE TIME DEVOTED TO NON-INTELLIGENCE 
RELATED OUTPUTS"; a three character integer numeric 
right-justified field with leading zeroes. 

card columns 42-76 were unused blanks. ] 

cc 77-79; "CARD NUMBER SIX SEQUENCE (CASE) NUMBER"; 

a three character numeric right-justified field with 
leading zeroes. VARO81 equalled VARO08, VARO23, 
VARO59, VARO67, and VARO75 in all cases. 

cc 80; "CARD SIX NUMBER"; a one character numeric 
fiela@. The only valid entry for this variahle was 


the number "6". 


Card Number Seven: 


VARO83; 


VARO 84; 


cc 1-75; “RESPONDENT'S AND CODER COMMENTS"; a 75 
character alphanumeric left-justified field with 
trailing blanks. 

cc 76; "COMMENTS CONTINUATION CCDE"; a one character 
numeric field. Only one of three values was coded in 
this field: "0" indicated that there were no comments 
associated with this case; "1" indicated that there 
were some eonment ss but that all comments were in- 
cluded within VARO83; "2" indicated that there were 


some comments continued beyond the capacity of VARO83. 
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VARO85; 


VARO 86; 


cc 77-79; "CARD NUMBER SEVEN SEQUENCE (CASE) NUMBER"; 
a three character right-justified field with leading 
zeroes. VARO85 equalled VARO08, VARO23, VARO59, 
VARO67, VARO75, and VARO81 in all cases. 

cc 80; "CARD SEVEN NUMBER"; a one character numeric 
field. The only valid entry for this variable was 


the number "7", 
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B. VARIABLE DECLARATIONS FOR THE MERGED 
QUESTIONNAIRE AND INTERVIEW CARDS (QICARDS) 


Card numbers one through seven immediately preceded the 

following appended card images. Codes for these variables 

are listed in Table D-9. 

Card Number Eight, Sub-card Number OL: 

VARO87; cc 1; “USED COLLEGE ALGEBRA LEVEL"; code = 01.1. 

VARO88; cc 2; "USED BEGINNING CALCULUS LEVEL"; code = 01.2. 

MeekUoGds Ce 3; USED) PROBABILITY AND STATISTICS LEVEL"? 
code = 01.3. 

VARO90; cc 4; “USED ADVANCED CALCULUS LEVEL"; code = 01.4. 

VARO91; cc 5; "USED FOREIGN LANGUAGE LEVEL"; code = 02.1. 

VARO92; cc 6; "USED USSR AREA STUDIES LEVEL"; code = 03.1. 


e095, cs 7; “USED PRC AREA STUDIES LEVEL"; code = 03.2. 


| 
(=) 
oO) 
Les 


VARO94; cc 8; "USED MID-EAST AREA STUDIES LEVEL"; code 


a] 
oS 
Les) 
An 


VARO95; cc 9; "USED EUROPEAN AREA STUDIES LEVEL"; code 
VARO96; cc 10; "USED LATIN AMERICAN AREA STUDIES LEVEL"; 

code = 03.5. 
VAR097; cc 11; "USED AFRICAN AREA STUDIES LEVEL"; code = 03.6. 
VARO98; cc 12; "USED OPERATIONS ANALYSIS LEVEL"; code = 04.1. 
VARO99; cc 13; "USED INTERNATIONAL RELATIONS LEVEL"; 

code = 05.1. 
VAR1L00; cc 14; "USED UNDERWATER ACOUSTICS LEVEL"; code = 06.1. 
VAR101; cc 15; "USED SONAR SYSTEMS LEVEL"; code = 06.2. 
VAR1L02; cc 16; "USED COMMUNICATIONS SYSTEMS LEVEL"; 

code = 06.3. 


WVARIO3+ ce 17; “USED RADAR SYSTEMS LEVEL"; code = 06.4. 
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VAR1O4; 
VAR1O5; 
VAR1O6; 
VAR107; 
VAR108; 
VAR109; 
VAR110; 
VAR111; 
VAR112; 
VAR113; 
VAR114; 
VAR115; 


VAR116; 


VAR1L17; 


cc 18; “USED OPTICAL SYSTEMS LEVEL"; code = 06.5. 
cc 19; "USED LASER SYSTEMS LEVEL"; code = 06.6. 

cc 20; "USED COLLECTION SYSTEMS LEVEL"; code = 06.7. 
cc 21; "USED NATIONAL/NAVAL BUDGET PROCESS LEVEL"; 
code = 07.1. 

cc 22; "USED THREAT & NET ASSESSMENT LEVEL"; 

code = 07.2. 

cc 23; "USED NATIONAL SECURITY AFFAIRS/INTELLIGENCE 
ORGANIZATION LEVEL"; code = 07.3. 

cc 24; "USED SOVIET NAVAL FORCES STUDIES LEVEL"; 
code = 08.1. 

ce 25; "USED SOVIET AIR FORCES STUDIES LEVEL"; 

code = 08.2, 

cc 26; "USED SOVIET GROUND FORCES STUDIES LEVEL"; 
code = 08.3. 

cc 27; "USED SOVIET PVO STRANYY STUDIES LEVEL"; 
code = 08.4, 

cc 28; “USED SOVIET STRATEGIC ROCKET TROOPS STUDIES 
LEVEL"; code = 908.5. 

ce 29; "USED SOVIET MERCHANT/FISHING/OCEANOGRAPHIC 
STUDIES LEVEL"; code = 08.6. 

cc 30; “USED BLUE FORCES COLLECTION SYSTEMS STUDIES 
LEVEL"; code = 09.1. 

cc 31; "USED UNITED STATES NAVAL FORCES STUDIES LEVEL"; 


code = 09.2, 
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WeRLIS; 


VARI19; 


VAR120; 


Vente; 


VAR122; 


VAR123; 


VAR124; 


VAR125: 


VAR126; 


VAR127; 


VAR128; 


VARI29; 


VAR1 30; 


VAR131; 


We 32 3 


[Note: 


Ceo 32; * USED 
LEVEL” ;.code 
cc 235) USED 
code = 09.4. 
ecers4, “USED 
code = 10.1. 
Cc 2575 USED 
code = 10.2. 
ce ™2e; “USED 
Codes — 10-3. 
Cease USED 
code = 10.4. 
ee 382 “USED 
eee 39+ Ss USED 
cc 40; “URED 
code = 11.3. 
coe. 41; “USED 
LEVEL"; code 
ce 42; “USED 
code = 1272. 
Ce 4378, 0SED 
code = 12.3. 
ec 44; “USED 
ee 7457) USED 
cc 46: "USED 


card columns 


UNITED STATES NON-NAVAL FORCES STUDIES 
— 0932. 

ALLIEDV CAPABILITY STUDIES GEVEL" ; 

ADP SYSTEM DESIGN/MANAGEMENT LEVEL"; 

ADP HARDWARE OPERATIONS LEVEL"; 

ADP SOFTWARE OPERATIONS LEVEL"; 

ADP BASIC INTERFACE OPERATION LEVEL"; 
BRIEPING TECHNIQUES LEVEL"; code = 11.1, 
WRITING SKELLS LEVEL"; code = 11.2. 
ORGANIZATION OF THOUGHT LEVEL"; 
MANAGEMENT OF COLLECTION SYSTEMS STUDIES 
= 12:1. 

PERT MANAGEMENT STUDIES LEVEL"; 


MANAGEMENT BY OBJECTIVES LEVEL"; 


PERSONNEL MANAGEMENT LEVEL"; code = 12.4. 


ieee 


FINANCIAL MANAGEMENT LEVEL"; code 


LABOR RELATIONS LEVEL"; code 12 6. 


47-73 were unused blanks. ] 
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VAR133; cc 74; “CODER RESPONSIBILITY CODE"; a one character 
Bemeric field. See fable D=4yferiwalid entries: 

VARI 34; cc 75-76; "CARD NUMBER 8-01 SUBCARD NUMBER"; a two 
character numeric right-justified field with leading 
zeroes. Always equalled "01" for this card. 

VAR135; cc 77-79; "CARD NUMBER 8-01 SEQUENCE (CASE) NUMBER": 
a three character numeric right-justified field with 
leading zeroes. VAR135 equalled VARO08, VAR023, 
VARO59, VARO67, VARO75, VARO81, and VARO85 in all 
cases, 

VAR136; cc 80; "CARD EIGHT, SUB-CARD 01, CARD NUMBER"; a one 
character numeric field. The only valid entry for 
this field was the number "8". 

Card Numher Fight, Sub-Card Number 0?: 

VAR137; cc 1; “NEEDED COLLEGE ALGEBRA LEVEL"; code = 01.1. 

VAR138; cc 2; "NEEDED BEGINNING CALCULUS LEVEL"; code = 01.2. 

VAR139; cc 3; "NEEDED PROBABILITY AND STATISTICS LEVEL": 
code = 01-3. 

VAR140; cc 4; “NEEDED ADVANCED CALCULUS LEVEL"; esce =“O1.04. 

VAR141: cc 5: “NEEDED FOREIGN LANGUAGE LEVEL"; code = 02.1. 

Wena? cc 6; “NEEDED USSR AREA STUDLES LEVEL"; code = 03.1. 

Beveas; Coe 7; “NEEDED PRC AREA STUDIES LEVEL"; code = 03.2. 

VAR144; cc 8; "NEEDED MID-EAST AREA STUDIES LEVEL"; code = 03.3. 

VAR145; cc 9; "NEEDED EUROPEAN AREA STUDIES LEVEL"; code = 03.4. 

VAR146; cc 10; “NEEDED LATIN AMERICAN AREA STUDIES LEVEL"; 


code = 03.5. 
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Wanda 7?:? ec 11> “NEEDED AFRICAN AREA STUDIES LEVEL": code = 03.6. 
VAR148; cc’12; "NEEDED OPERATIONS ANALYSIS LEVEL"; code = 04.1. 
VAR149; cc 13; “NEEDED INTERNATIONAL RELATIONS LEVEL"; 
code = 05.1. | 
VAR150; cc 14; "NEEDED UNDERWATER ACOUSTICS LEVEL": code = 06.1. 
VARL51; cc 15; "NEEDED SONAR SYSTEMS LEVEL"; code = 06.2. 
wWentes2: cc 16; “NEEDED COMMUNICATIONS SYSTEMS LEVEL"; 
Geode = 06.3. 
VARI53; cc 17; "NEEDED RADAR SYSTEMS LEVEL"; code = 06.4. 
Period; ceule, “NEEDED OPTICAL SYSTEMS LEVEL"; code = 06.5. 
Wants 5s> cc 19; "NEEDED LASER SYSTEMS LEVEL"; code = 06.6. 
VARI56; cc 20; “NEEDED COLLECTION SYSTEMS LEVEL"; code = 06.7. 
VAR157; cc 21; “NEEDED NATIONAL/NAVAL BUDGET PROCESS LEVEL"; 
code = 07,1. 
VAR158; cc 22; “NEEDED THREAT & NET ASSESSMENT LEVEL"; 
code = 07.2. 
VAR159; cc 23; "NEEDED NATIONAL SECURITY AFFAIRS/ INTELLIGENCE 
ORGANIZATION MEVEL: code = 07.3. 
VAR160; cc 24; "NEEDED SOVIET NAVAL FORCES STUDIES LEVEL"; 
code = 08.1. 
Seeeol; cc 25; "NEEDED SOVIET AIR FORCES STUDIES LEVEL"; 
code = 08.2. 
VAR162; cc 26; “NEEDED SOVIET GROUND FORCES STUDIES LEVEL"; 
code = 08.3. 
Pestes; ce 27; “NEEDED SOVIET PVO STRANYY STUDIES LEVEL"; 


code = 08.4. 
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VAR164; cc 28; "NEEDED SOVIET STRATEGIC ROCKET TROOPS STUDIES 
LEVEL"; code = 08.5. 

VAR165; cc 29; "NEEDED SOVIET MERCHANT/FISHING/OCEANOGRAPHIC 
STUDIES LEVEL"; code = 08.6. 

WART66; cc 30; "NEEDED BLUE FORCES COLLECTION SYSTEMS STUDIES 
LEVEL"; code = 09.1. 

VARIG7; cc 31; "NEEDED UNITED STATES NAVAL FORCES STUDIES 
LEVEL”; code = 09.2. 

VAR168; cc 32; "NEEDED UNITED STATES NON-NAVAL FORCES STUDIES 
LEVEL"; coae = 09.3. 

VAR169; cc 33; "NEEDED ALLIED CAPABILITY STUDIES LEVEL"; 
code = 09.4, 

VAR170; cc 34; "NEEDED ADP SYSTEM DESIGN/MANAGEMENT LEVEL"; 
code = 190.1. 

VARL71; cc 35; “NEEDED ADP HARDWARE OPERATIONS LEVEL"; 
code = 10.2. 

VAR172; cc 36; “NEEDED ADP SOFTWARE OPERATIONS LEVEL"; 
code = 10.3. 

heres; coe 37; “NEEDED ADP BASIC INTERFACE OPERATION LEVEL"; 
code = 10.4. 

Werl/4; ce 38; “NEEDED BRIEFING TECHNIQUES LEVEL"; code = 1l1l.i. 

Pew; cc 39; "NEEDED WRITING SKILLS LEVEL”; code = 11.2 

VAR176; cc 40; “NEEDED ORGANIZATION OF THOUGHT LEVEL"; 

eoqde f= "113: 
VAR1L77; cc 41; “NEEDED MANAGEMENT OF COLLECTION SYSTEMS 


STUDIES LEVEL"; code = 12.1. 
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VAR178; 
VAR179; 
VAR180; 
VAR181; 
VAR182; 


{[Note: 


VAR183; 


VAR1 84; 


VAR185; 


VAR1 86; 


cc 42; "NEEDED PERT MANAGEMENT STUDIES LEVEL"; 
code = 12.2. 
cc 43; "NEEDED MANAGEMENT BY OBJECTIVES LEVEL"; 


code = 12.3. 


cc 44; "NEEDED PERSONNEL MANAGEMENT LEVEL"; code 12.4. 


cc 45; “NEEDED FINANCIAL MANAGEMENT LEVEL"; code PA pe oan 
cc 46; "NEEDED LABOR RELATIONS LEVEL"; code = 12.6. 

card columns 47-73 were unused blanks.] 

ec 74; “CODER RESPONSIBILITY CODE"; a one character 
numeric field. VAR183 equalled VAR133 in all instances. 
See Table D-4 for valid entries. 

cc 75-76; “CARD NUMBER 8-02 SUBCARD NUMBER"; a two 
character numeric right-justified field with leading 
zeroes. Always equalled "02" for this card. 

cc 77-79; “CARD NUMBER 8-02 SEQUENCE (CASE) NUMBER"; 

a three character numeric right-justified field with 
leading zeroeS. VAR185 equalled VAROO8, VARO23, VAROS57, 
VARO75, VARO81, VARO85, and VAR135 in all cases. 

cc 80; "CARD EIGHT, SUB-CARD 02, CARD NUMBER"; a one 
character numeric field. The only valid entry for this 


field was the number "8", 
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C. VARIABLE DECLARATIONS FOR THE MERGEC QUESTIONNAIRE, 
INTERVIEW, AND DICARDS FILE (QFDICARD) 


Card numbers one through eight (sub-card 02) immediately 
preceded the following appended card images. 


Card Number Eight, Sub-card Number 03: 


VAR187; 


VAR1L88; 


MARIG9 ; 


VAR190; 


VARLO1; 


VAR192; 


cc 1-3; "Dl PERCENTAGE ADMINISTRATION OF INTELLIGENCE 
OFFICE"; a three character integer numeric right- 
justified field with leading zeroes. This variable 
was coded "999" if the percentage were unknown. 

cc 4-6; "Dl PERCENTAGE RESOURCE/ORGANIZATIONAL 
MANAGEMENT"; a three character integer numeric right- 
justified field with leading zeroes. This variable 
was coded "999" if the percentage were unknown. 

cc 7-9; "Dl PERCENTAGE BUDGETING AND FISCAL PLANNING"; 
a three character integer numeric right-justified field 
with leading zeroes. This variable was coded "999" if 
the percentage were unknown. 

cc 10-12; "Dl PERCENTAGE DECISIONS AND RECOMMENDATIONS"; 
a three character integer numeric right-justified 
field with leading zeroes. This variable was coded 
"999" if the percentage were unknown. 

cc 13-15; "Dl PERCENTAGE BRIEFS AND DEBRIEFS"; a three 
character integer numeric right-justified field with 
leading zeroes. This variable was coded "999" if 

the percentage were unknown. 

cc 16-18; "Dl PERCENTAGE LIAISON"; a three character 


integer numeric right-justified field with leading 


286 





VARS; 


VAR194; 


We LoD } 


VAR196; 


VAR197; 


VAR198; 


zeroes. This variable was coded "999" if the 
percentage were unknown. 

cc 19-21; "Dl PERCENTAGE CHARTS AND AUDIO-VISUAL AIDS"; 
a three character integer numeric right-justified field 
with leading zeroes. This variable was coded "999" 

if the percentage were unknown. 

Ger22—-24;> "DIP PEREENTAGE COUNTERINTELLIGENCE STUDIES"; 
a three character integer numeric right-justified 

field with leading zeroes. This variable was coded 
wg90” iG the percentage were unknown. 

Ce 7259-27; Dl PERCENTAGE DATA ANALYSIS"=> a three 
character integer numeric right-justified field with 
leading zeroes. This variable was coded "999" if 

the percentage were unknown. 

cc 28-30; "Dl PERCENTAGE ESTIMATES"; a three character 
integer numeric right-justified field with leading 
zeroes. This variable was coded "999" if the percentage 
were unknown. 

cc 31-33; "Dl PERCENTAGE INTELLIGENCE ANNEXES TO 
OPORDS"; a three character integer numeric right- 
justified field with leading zeroes. This variable 

was coded "999" if the percentage were unknown. 

cc 34-36; "Dl PERCENTAGE INTELLIGENCE COLLECTION PLANS"; 
a three character integer numeric right-justified field 
with leading zeroes. This variable was coded "999" 


if the percentage were unknown. 
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VAR199; 


VAR200; 


VAR201; 


VAR202; 


VAR203; 


VAR204; 


VAR205; 


cc 37-39; "Dl PERCENTAGE INTELLIGENCE COLLECTION 
TASKING"; a three character integer numeric right- 
justified field with leading zeroes. This variable 
was coded "999" if the percentage were unknown. 

cc 40-42; "Dl PERCENTAGE INTELLIGENCE INFORMATION 
REPORTS"; a three character integer numeric right- 
justified field with leading zeroes. This variable 
was coded "999" if the percentage were unknown. 

cc 43-45; "Dl PERCENTAGE INTERFACE WITH ADP/TELECOM- 
MUNICATIONS"; a three character integer numeric 
right-justified field with leading zeroes. This 
variable was coded "999" if the percentage were 
unknown. 

cc 46-48: "Dl PERCENTAGE ORDERS-OF-BATTLE": a three 
character integer numeric right-justified field with 
leading zeroes. This variable was coded "999" if 
the percentage were unknown. 

cc 49-51; "Dl PERCENTAGE PHYSICAL SECURITY"; a three 
character integer numeric right-justified field with 
leading zeroes. This variable was coded "999" if 
the percentage were unknown. 

cc 52-54; "Dl PERCENTAGE TACTICAL PLOTS"; a three 
character integer numeric right-justified field with 
leading zeroes. This variable was coded "999" if 
the percentage were unknown, 

cc 55-57; "Dl PERCENTAGE NON-INTELLIGENCE RELATED 


OUTPUTS"; a three character integer numeric right 
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VAR206; 


[Note: 


VAR207; 


VAR208; 


VAR209; 


(istinied icldewithieleading 2Zerorce iis variable 

was coded "999" if the percentage were unknown. 

cc 58-60; "Dl PERCENTAGE COUNSELING AND TRAINING"; 

a three character integer numeric right-justified field 
with leading zeroes. This variable was coded "999" 

if the percentage were unknown. 

card columns 61-71 were unuSed blanks. ] 

cc 72; "SPECIAL CASE FLAG"; a one character numeric 
field. Only one of two different values was coded in 
this field: "0" indicated no special handling was 
required of this case; "1" indicated special external 
handling was required of this case. 

cc 73; "ANSWER TO DEFENSE INTELLIGENCE SCHOOL QUESTION"; 
a one character numeric field. Only one of three dif- 
ferent values was coded in this field: "0" indicated 
that the question was not asked in the DELPHI; "1" 
indicated that the question was asked of the respon- 
dent and that he answered in the negative;' "3" indi- 
cated that the question was asked of the respondent 

and that his answer was in the affirmative. 

cc 74: “DELPHI RESPONSE VALIDITY CODE"; a one character 
numeric field. Only one of two different values was 
coded in this field: "0" indicated that the information 
contained in this card was not a response to the DELPHI 
Questionnaire, but only a dummy record generated by the 


file generation program; "1" indicated that the 
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VAR210; 


VAR211; 


VAR212; 


The 


by case 


information contained was a valid response to the 
questionnaire. A "0" code implied VAR187 through 
VAR206 were "999's", 

cc 75-76; “CARD NUMBER 8-03 SUBCARD NUMBER"; a two 
character numeric right-justified field with leading 
zeroes. Always equalled "03" for this card. 

Gee? 7-79-— CARD NUMBER 8-03 SEQUENCE (CASE) NUMBER”; 
a three character numeric right-justified field with 
leading zeroes. VAR211 equalled VARO08, VARO23, 
VARO59, VARO67, VARO75, VARO81, VARO85, VAR135, and 
VAR185 in all cases. 

cc 80; "CARD EIGHT, SUB-CARD 03, CARD NUMBER"; a one 
character numeric field. The only valid entry for 


his field was the number "8". 


DICARDS were mechanically sorted in ascending order 


number prior to having been placed on disk storage. 
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D. VARIABLE DECLARATIONS FOR THE MERGED QUESTIONNAIRE, 


INTERVIEW, DICARDS, AND D2CARDS (QID12CDS) 


Card numbers one through eight (Sub-card 03) 
preceded the following appended card images. 


immediately 


Card Number Eight, Sub-card Number 04: 


VAR213; cc 1; "D2 USED COLLEGE ALGEBRA LEVEL"; a one character 
numeric field. 

VAR214; cc 2; "D2 NEEDED COLLEGE ALGEBRA LEVEL"; a one 
character numeric field. 

VAR215; cca 3; "D2 FUTURE COLLEGE ALGEBRA LEVEL"; a one 
character numeric field. 

VAR216; cc 4; "D2 USED BEGINNING CALCULUS LEVEL"; a one 
character numeric field. 

VAR217; cc 5; "D2 NEEDED BEGINNING CALCULUS LEVEL"; a one 
character numeric field. 

VAR218; cc 6; "D2 FUTURE BEGINNING CALCULUS LEVEL"; a one 
character numeric field. 

VAR219; cc 7; “D2 USED ADVANCED CALCULUS LEVEL"; a one 
character numeric field. 

VAR220; cc 8; "D2 NEEDED ADVANCED CALCULUS LEVEL"; a one 
character numeric field. 

VAR221; cc 9; "D2 FUTURE ADVANCED CALCULUS LEVEL"; a one 
character numeric field. 

See 22; Ccevl0; “D2 USED PROBABLLITY AND STATISTICS LEVEL"; 
a one character numeric field. 

Man222> ce ll: “D2) NEEDED PROBABILITY AND STATISTICS LEVEL"; 


a one character numeric field. 
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waked: cco 12: "D2 FUTURE PROBABILITY AND STATISTICS LEVEL"; 
a one character numeric field. 

VAR225; cc 13; "D2 USED FOREIGN LANGUAGE LEVEL": a one 
character numeric field. 

VAR226; cc 14; "D2 NEEDED FOREIGN LANGUAGE LEVEL"; a one 
character numeric field. 

VAR227: cc 15; "D2 FUTURE FOREIGN LANGUAGE LEVEL"; a one 
character numeric field. 

VAR228; cc 16: "D2 USED USSR AREA STUDIES LEVEL"; a one 
character numeric field. 

VAR229; cc 17; "D2 NEEDED USSR AREA STUDIES LEVEL"; a one 
character numeric field. 

VAR230; cc 18; "D2 FUTURE USSR AREA STUDIES LEVEL"; a one 
character numeric field. 

VAR231; cc 19; "D2 USED PRC AREA STUDIES LEVEL"; a one 
character numeric field. 

VAR232; cc 20; "D2 NEEDED PRC AREA STUDIES LEVEL"; a one 
character numeric field. 

Wee; cc 21; "D2 FUTURE PRC AREA STUDIES LEVEL"; a one 
character numeric field. 

VAR234; cc 22; "D2 USED MIDDLE EAST AREA STUDIES LEVEL"; a 
one character numeric field. 

Weezs5; ce 23; "D2 NEEDED MIDDLE EAST AREA STUDIES LEVEL"; a 
one character numeric field. 

VAR236; cc 24; "D2 FUTURE MIDDLE EAST AREA STUDIES LEVEL"; 


a one character numeric field. 
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VAR237; cc 25; "D2 USED EUROPEAN AREA STUDIES LEVEL": a one 
character numeric field. 

VAR238: cc 26; "D2 NEEDED EUROPEAN AREA STUDIES LEVEL"; a 
one character numeric field. | 

WARZ39;> co 27; “D2 FUTURE EUROPEAN AREA STUDIES LEVEL”; a 
one character numeric field. 

VAR240;: cc 28; "D2 USED LATIN AMERICAN AREA STUDIES LEVEL"; 
a one character numeric field. 

VAR241; cc 29; "D2 NEEDED LATIN AMERICAN AREA STUDIES LEVEL"; 
a One character numeric field. 

VAR242; cc 30; "D2 FUTURE LATIN AMERICAN AREA STUDIES LEVEL"; 
a one character numeric field. 

VAR243; cc 31; "D2 USED AFRICAN AREA STUDIES LEVEL"; a one 
character numeric field. 

VAR244;: cc 32; "D2 NEEDED AFRICAN AREA STUDIES LEVEL"; a one 
character numeric field. 

VAR245; cc 33; "D2 FUTURE AFRICAN AREA STUDIES LEVEL"; a one 
character numeric field. 

VAR246;: cc 34; "D2 USED OPERATIONS ANALYSIS LEVEL"; a one 
character numeric field. 

VAR247; cca 35; "D2 NEEDED OPERATIONS ANALYSIS LEVEL"; a one 
Chanacter mumenic field . 

VAR248; cc 36; "D2 FUTURE OPERATIONS ANALYSIS LEVEL"; a one 
character numeric field. 

VAR249; ce 37; "D2 USED INTERNATIONAL RELATIONS THEORY LEVEL"; 


a one character numeric field. 
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VAR250; 


VAR251; 


VAR2 52; 


Vanes; 


VAR2 54; 


VAR255; 


VerR 220; 


VAR257; 


VAR258; 


VAR259; 


VAR260; 


VAR261; 


VAR262; 


cc 38; "D2 NEEDED INTERNATIONAL RELATIONS THEORY 
LEVEL"; a one character numeric field. 

cc 39; "D2 FUTURE INTERNATIONAL RELATIONS THEORY 
LEVEL"; a one character numeric field. 

cc 40; “D2 USED UNDERWATER ACOUSTICS LEVEL"; a one 
character numeric field. 

ce 41; "D2 NEEDED UNDERWATER ACOUSTICS LEVEL": a one 
character numeric field. 

cc 42; "D2 FUTURE UNDERWATER ACOUSTICS LEVEL"; a one 
character numeric field. 

cc 43: "D2 USED SONAR SYSTEMS LEVEL"; a one character 
numeric field. 

cc 44; "D2 NEEDED SONAR SYSTEMS LEVEL"; a one 
charactex numeric field. 

ee 45-9 "h2 FUTURE SONAR SYSTEMS LEVEL"; a one 
character numeric field. 

cc 46; "D2 USED COMMUNICATIONS SYSTEMS LEVEL"; a one 
character numeric field. 

cc 47; "D2 NEEDED COMMUNICATIONS SYSTEMS LEVEL"; a one 
character numeric field. 

cc 48; "D2 FUTURE COMMUNICATIONS SYSTEMS LEVEL"; a one 
character numeric field. 

cc 49; "D2 USED RADAR SYSTEMS LEVEL"; a one character 
numeric field. 

cc 50; "D2 NEEDED RADAR SYSTEMS LEVEL"; a one character 


numeric field. 
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VAR2 63; 


VAR264; 


VAR265; 


VAR266; 


VAR267; 


VAR268; 


VARZ69: 


VAR270; 


VAR271; 


VAR272; 


VAR273; 


Ce, Dl PZePULURE RADAR SYSTEMS LEVEL"; a one 
Gharacter numeric field. 

cc 52; "D2 USED OPTICS LEVEL": a one character 
numeric field. | 

Ce 537  'D2 NEEDED OPTICS LEVEL"; a one character 
numeric field. 

cc 54; "D2 FUTURE OPTICS LEVEL"; a one character 
numeric field. 

Ge 5S7) D2QUSED LASERS LEVEL"; a one character 
numeric field. 

cc 56; "D2 NEEDED LASERS LEVEL"; a one character 
mumeric field. 

cc 57; "D2 FUTURE LASERS LEVEL"; a one character 
numeric field. 

Ceno0, b250USED COLEECTION SYSTEMS LEVEL" > a one 
character numeric field. 

Geu59; “D2 NEEDED) COLLECTION SYSTEMS LEVEL"; a one 
character numeric field. 

Ceuo0; 'P20FUTURE COLLECTION SYSTEMS LEVEL"; a one 
character numeric field. 

cc 61; “SPECIAL CASE FLAG"; a one character numeric 
field. Only one of two different values was coded in 
this field: "0" indicated no special handling was 
required of this case; "1" indicated special external 
handling was required of this case. VAR273 had the 
Same purpose aS VAR207 except that it came later 


chronologically in the project. 
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(Note: 


VAR2 74; 


_VAR275; 


VAR2Z7€; 


VAR277; 


card columns 62-73 were unused blanks. ] 

Ce 74-) DELPHT RESPONSE VALIDITY CODE";> a one 
character numeric field. Only one of two different 
values was coded in this field: "0" indicated that 
the information contained in this card was not a 
response to the DELPHI Questionnaire, but only a 
dummy record generated by the file generation program; 
"1" indicated that the information contained was a 
valid response to the questionnaire. A "0" implied 
VAR213 through VAR272 were "9's", 

cc 75-76; "CARD NUMBER 8-04 SUBCARD NUMBER"; a two 
character numeric right-justified field with leading 
zeroes. Always equalled "04" for this card. 

C6liv= 79>) CARD NUMRER 8-04 SEQUENCE (CASE) NUMBER"; 
a three character numeric right-justified field with 
leading zeroes. VAR276 equalled VARO0O8, VARO023, 
VARO59, VARO67, VARO75, VARO81, VARO85, VAR135, 
VARL85, and VAR211 in all cases. 

cc 80; "CARD EIGHT, SUB-CARD 04, CARD NUMBER"; a one 
character numeric field. The only valid entry for 


this field was the number "8". 


Card Number Eight, Sub-card Number 05: 


VAR278: 


VAR279; 


cc 1; "D2 USED THREAT/NET ASSESSMENT LEVEL"; a one 
character numeric field. 
cc 2; "D2 NEEDED THREAT/NET ASSESSMENT LEVEL"; a one 


character numeric field. 
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VAR280; 


VAR281; 


VAR2 82; 


VAR283; 


VAR2 84; 


VAR285; 


VAR2 86; 


VAR2 87; 


VAR2 88; 


VAR2 89; 


VAR290; 


VAR291; 


MeR2 9 2? 


cc 3; *"D2 FUTURE THREAT/NET ASSESSMENT LEVEL"; a one 
Character numeric field. 

cc 4; "D2 USED NATIONAL SECURITY/INTELLIGENCE 
ORGANIZATION LEVEL"; a one character numeric field. 
cc 5; "D2 NEEDED NATIONAL SECURITY/INTELLIGENCE 
ORGANIZATION LEVEL"; a one character numeric field. 
cc 6; "D2 FUTURE NATIONAL SECURITY/INTELLIGENCE 
ORGANIZATION LEVEL"; a one character numeric field. 
Ge 7>- "D2 USED SOVIET NAVAL FORCES STUDIES LEVEL”; 

a one character numeric field. 

cCe,a;) "D2 NEEDED SOVIET NAVAL FORCES STUDIES LEVEL”; 
a one character numeric field. 

cc 9; "D2 FUTURE SOVIET NAVAL FORCES STUDIES LEVEL"; 
a One character numeric field. 

cen) (2 UetbesOvVIET ALR @EORCES STUDIES LEVEL > 

a one character numeric field. 

Ce lls) D2 NEEDED SOVIET ALR FORGES STUDIES LEVEL"; 
a one character numeric field. 

ceul2 s) D2 FUTURE SOVIETMALR FORCES STUDIES LEVEL”; 
a one character numeric field. 

cc 13; "D2 USED SOVIET GROUND FORCES STUDIES LEVEL"; 
a one character numeric field. 

cc 14; "D2 NEEDED SOVIET GROUND FORCES STUDIES LEVEL"; 
a one character numeric field. 

ce 15> "D2 FUTURE SOVIET GROUND FORCES STUDIES LEVEL"; 


a one character numeric field. 
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VAR293; 


VAR294; 


VAR295; 


VAR296; 


Viakco 7? 


VAR298; 


VAR299; 


VAR300; 


VAR301; 


VAR302; 


VAR303; 


VAR304; 


VAR305; 


SomlG D2 USED oOVIET SURATEGIC ROCKET TROOPS 

STUDIES LEVEL"; a one character numeric field. 

cc 17; "D2 NEEDED SOVIET STRATEGIC ROCKET TROOPS 
STUDIES LEVEL"; a one character numeric field. 

Cove)  D297UTURE SOVIET STRATEGIC ROCKET TROOPS 
STUDIES LEVEL"; a one character numeric field. 

cc 19; "D2 USED SOVIET MERCHANT/FISHING/OCEANOGRAPHIC 
STUDIES LEVEL"; a One character numeric field. 

cc 20; “D2 NEEDED SOVIET MERCHANT/FISHING/OCEANOGRAPHIC 
STUDIES LEVEL"; a one character numeric field. 

cc 21; "D2 FUTURE SOVIET MERCHANT/FISHING/OCEANOGRAPHIC 
STUDIES LEVEL"; a one character numeric field. 

ce 22; "D2 USED UNITED STATES NAVAL FORCES STUDIES 
LEVEL"; a one character numeric field. 

cc 23; "D2 NEEDED UNITED STATES NAVAL FORCES STUDIES 
LEVEL"; a one character numeric field. 

cc 24; "D2 FUTURE UNITED STATES NAVAL FORCES STUDIES 
LEVEE eae One enatdeter numeric field. 

ec 25; "D2 USED UNITED STATES NON-NAVAL FORCES STUDIES 
LEVEL"; a one character numeric field. 

ce 26; "D2 NEEDED UNITED STATES NON-NAVAL FORCES 
STUDIES LEVEL"; a one character numeric field. 

cc 27; "D2 FUTURE UNITED STATES NON-NAVAL FORCES 
STUDIES LEVEL"; a one character numeric field. 

ee 26; D2) USED ALuIED CAPABILITY STUDIES LEVEL" = 


a one character numeric field. 
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WA s0o; co 22; “D2 NEERED ALLIED CAPABILITY STUDIES LEVEL"; 
‘a one character numeric field. 

VAR307; cc 30; "D2 FUTURE ALLIED CAPABILITY STUDIES LEVEL"; 
a one character numeric field. 

VAR308: cc 31; "D2 USED ADP SYSTEM DESIGN/ANALYSIS LEVEL"; 
a one character numeric field. 

VAR309; cc 32; "D2 NEEDED ADP SYSTEM DESIGN/ANALYSIS LEVEL"; 
a one character numeric field. 

VAR310; cc 33; "D2 FUTURE ADP SYSTEM DESIGN/ANALYSIS LEVEL"; 
a one character numeric field, 

VAR311; cc 34; “D2 USED ADP HARDWARE OPERATIONS LEVEL"; a 
one character numeric field. 

VAR312; cc 35; "D2 NEEDED ADP HARDWARE OPERATIONS LEVEL"; 
a one character numeric field. 

VAR313; cc 36; "D2 FUTURE ADP HARDWARE OPERATIONS LEVEL"; 
a one character numeric field. 

VAR314; cc 37; "D2 USED ADP PROGRAMMING LEVEL"; a one 
character numeric field. 

VAR315; cc 38; "D2 NEEDED ADP PROGRAMMING LEVEL"; a one 
character numeric field. 

VAR316; cc 39; "D2 FUTURE ADP PROGRAMMING LEVEL"; a one 
character numeric field. 

VAR317; cc 40; "D2 USED BASIC ADP INTERFACE OPERATIONS LEVEL"; 
a one character numeric field. 

Marois; ce 41> "D2 NEEDED BASIC ADP INTERFACE OPERATIONS 


LEVEL"; a one character numeric field. 
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VAR319; 


VAR320; 


VAR321; 


VARS22; 


(2323; 


VAR324; 


VAR325; 


VAR326; 


Wee |; 


VAR328; 


VAR329; 


VAR330; 


VAR331; 


cc 42; "D2 FUTURE BASIC ADP INTERFACE OPERATIONS 
LEVEL"; a one character es frei. 

cc 43; “D2 USED MANAGEMENT BY OBJECTIVES LEVEL"; 

a one character numeric field. 

cc 44; "D2 NEEDED MANAGEMENY BY OBJECTIVES LEVEL"; 

a One character numeric field. 

cc 45; "D2 FUTURE MANAGEMENT BY OBJECTIVES LEVEL"; 

a one character numeric field. 

cc 46; "D2 USED PERSONNEL MANAGEMENT LEVEL"; a one 
character numeric field. 

cc 47; "D2 NEEDED PERSONNEL MANAGEMENT LEVEL"; a one 
character numeric field. 

cc 48; "D2 FUTURE PERSONNEL MANAGEMENT LEVEL"; a one 
character numeric field. 

cc 49; "D2 USED FINANCIAL MANAGEMENT LEVEL"; a one 
character numeric field. 

cc 50: "D2 NEEDED FINANCIAL MANAGEMENT LEVEL"; a one 
character numeric field. 

ec 51; "D2 FUTURE FINANCIAL MANAGEMENT LEVEL" ; a one 
character numeric field. 

cc 52; "D2 USED NATIONAL/NAVAL BUDGET MANAGEMENT 
LEVEL"; a one character numeric field. 

cc 53; "D2 NEEDED NATIONAL/NAVAL BUDGET MANAGEMENT 
LEVEL"; a one character numeric field. 

cc 54; "D2 FUTURE NATIONAL/NAVAL BUDGET MANAGEMENT 


LEVEL"; a one character numeric field. 
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VAR332; 


VAR333; 


VAR334; 


VAR335; 


VAR336; 


VAR337;3 


VAR338;3 


VAR339; 


VAR340; 


VAR341; 


VAR342; 


VAR343; 


(Note: 


Cems.) Oe UahD LABOR RELATIONS MANAGEMENT LEVEL > 

a one character numeric field. 

cc 56; "D2 NEEDED LABOR RELATIONS MANAGEMENT LEVEL"; 
a One character numeric field. 

cc 57; “D2 FUTURE LABOR RELATIONS MANAGEMENT LEVEL"; 
a one character numeric field. 

Cc voc wee UShOe BRIEFING SKILLS LEVEL"; a one 
character numeric field. 

cc 59; "D2 NEEDED BRIEFING SKILLS LEVEL"; a one 
character numeric field. 

cc 60; “D2 FUTURE BRIEFING SKILLS LEVEL"; a one 
character numeric field. 

cc 61; "D2 USED WRITING SKILLS LEVEL"; a one character 
numeric field. 

cc 62; “D2 NEEDED WRITING SKILLS LEVEL": a one 
character numeric field. 

cc 63: “D2 FUTURE WRITING SKILLS LEVEL"; a one 
character numeric field. 

cc 64; "D2 USED ORGANIZATION OF THOUGHT LEVEL"; a 
One character numeric field. 

cco 65; "D2 NEEDED ORGANIZATION OF THOUGHT LEVEL"; a 
one character numeric field. 

cc 66; "D2 FUTURE ORGANIZATION OF THOUGHT LEVEL"; a 
one character numeric field. 


card columns 67-73 were unused blanks.] 
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VAR344; 


VAR345; 


VAR346; 


VAR347; 


cc 74; "DELPHI RESPONSE VALIDITY CODE"; a one 
character numeric field. Only one of two different 
values was coded in this field. "0" indicated that 
the information contained in this card was not a 
response to the DELPHI Questionnaire, but only a 
dummy record generated by the file generation program; 
"1" indicated that the information contained was a 
valid response to the queStionnaire. A "0" implied 
VAR278 through VAR343 were "9's". 

cc 75-76; "CARD NUMBER 8-05 SUBCARD NUMBER"; a two 
character numeric right-justified field with leading 
zeroes. Always equalled "05" for this card. 

cc 77-79; "CARD NUMBER 8-05 SEQUENCE (CASE) NUMBER"; 
a three character numeric richt-iustified field with 
leading zeroes. VAR346 equalled VAROO8, VARO23, 
VARO59, VARO67, VARO75, VARO81, VARO85, VAR135, 
VAR185, VAR211, and VAR276 in all cases. 

cc 80; "CARD EIGHT, SUB-CARD 05, CARD NUMBER"; a one 
character numeric field. The only valid entry for 


this field was the number "8". 
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TABLE D-1 


LIST OF VALID UNIT IDENTIFICATION CODES 
WITH ADDRESSES IN ALPHABETIC ORDER 


ASSIGNED 
UIC 


99910 


96013 


62982 


999.36 


92939 


63842 


65792 


62919 


99923 


COMMAND NAME 


Attn: U.S. Documents Officer 
Commander in Chief 

Eastern Atlantic Area 

APO New York 09218 


Center for Naval Analyses 
1401 Wilson Blvd. 
Arlington, Virginia 22209 


Chief 

Navy Advisory Group 

U.S. Military Assistance Command, 
Thailand 

APO San Francisco 96346 


Chief of Naval Operations 
{Attns Oroosr) 

1401 Wilson Blvd. 
Arlington, Virginia 22209 


Commandant 
Defense Intelligence School 
Washington, D.C. 20301 


Commander 
Antilles Defense Command 
FPO New York 09551 


Commander 

Atlantic Command Electronic 
Intelligence Center 

Norfolk, Virginaza 23511 


Commander 
Caribbean Sea Frontier 
FPO New York 09551 


Commander 


Cruiser Destroyer Group 12 
FPO New York 09501 
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10. 


Je 


2 


Le 


14. 


Ieee 


Ge 


Iie: 


IS. 


no. 


DOO 2 


62928 


29929 


O7117 


09550 


09946 


09930 


57014 


69519 


00015 


Commander 
Cruiser Destroyer Group 8 
FPO New York 09501 


Commander 

Eastern Sea Frontier 

Flushing and Washington Avenue 
Brooklyn, New York 11251 


Commander 

Fighter/Airborne Early 
Warning Wing Pacific 

Naval Air Station Miramar 
San Diego, California 92145 


Commander 

Fleet Alm Keflavik 
Box 2 

FPO New York 09571 


Commander 
Fleet Air Mediterranean 
FPO New York 09521 


Commander 

Fleet Air Reconnaissance 
Squadron Two 

FPO New York 09501 


Commander 

Fleet Air Reconnaissance 
Squadron One 

FPO San Francisco 96601 


Commander 

Iceland Defense Force 
Box 

FPO New York 09571 


Commander 

Medium Attack Wing One 

Naval Air Station Oceana 
Virginia Beach, Virginia 23460 


Commander 

Naval Intelligence Command 
Naval Intelligence Command Hqtrs 
2461 Eisenhower Avenue 
Alexandria, Virginia 22331 
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20. 


Bde 


22. 


253), 


24, 


Zs 


ZG. 


27. 


Zc. 


29. 


SO. 


63013 


05917 


92930 


99914 


gO9 35 


31585 


99934 


57006 
62894 


62822 


Commander 

NUWPNTRAGRUPAC 

Naval Air Station 

North Island 

San Diego, California 92135 


Commander 
Patrol Wing One 
FPO Seattle 98768 


Commander 

Patrol Wings Pacific 

Naval Air Station 

Moffett Field, California 94035 


Commander 

Reconnaissance Attack Wing 1 
Naval Air Station 

Albany, Georgia 31703 


Commander 

Task Force 168 

Hoffman Building 1 

2461 Eisenhower Avenue 
Alexandria, Virginia 22331 


Commander 
Task Force 72 
FPO Seattle 98762 


Commander 
U. S. Forces Korea 
APO San Francisco 96301 


Commander 

U. S. Naval Forces 
Philippines 

FPO San Francisco 96650 


Commander 
U. S. Naval Forces Japan 
FPO Seattle 98762 


Commander 
U. S. Naval Forces Korea 
APO San Francisco 96301 


Commander 
U. S. Taiwan Defense Command 
APO San Francisco 96263 
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Bl. 


es 


33) 2 


34. 


S595 


30. 


Se 


30, 


So. 


40. 


41. 


42. 


43. 


44, 


45. 


57015 


57019 


535297 


Sobee 


B02 09 


55261, 


shepeseny 


999'02 


Bia ee 


99904 


99905 


299 0c 


999.07 


Slag f 


00066 


Commander Amphibious Forces 
Upeor at lancriecer lect 
N@riLolk, Virginia, 25520 


Commander Amphibious Forces 
Uj 6, Pacific Fleet 
San Diego, California 92155 


Commander Amphibious Squadron 
FPO San Francisco 96601 


Commander Amphibious Squadron 
FPO San Francisco 96601 


Commander Amphibious Squadron 
FEO San Francisco 96601 


Commander Amphibious Squadron 
FPO San Francisco 96601 


Commander Carrier Group 1 
FPO San Francisco 96601 


Commander Carrier Group 2 
FPO New York 09501 


Commander Carrier Group 3 
FPO San Francisco 96601 


Commander Carrier Group 4 
FPO New York 09501 


Commander Carrier Group 5 
FPO San Francisco 96601 


Commander Carrier Group 6 
FPO New York 09501 


Commandex Carrier Group 7 
FPO San Francisco 96601 


Commander in Chief 
Alaska 
APO Seattle 98742 


Commander in Chief 
Atlantic 

Naval Base 

NOGGicik- Virginia 23511 


306 





46. 


47. 


48. 


49. 


50. 


ol. 


SI 


Bisis 


54. 


2o% 


315) 5 


D7 


Boi. 


Boog 
00060 
00061 
00070 
ia 
57007 


57012 


57025 


63981 


08961 
57024 
57042 


57016 


Commander in Chief 
Pacific 
FPO San Francisco 96610 


Commander in Chief. 
U. S. Atalantic Fleet 
Nortolic, Virginia’ 22511 


Commander in Chief 
U. S. Naval Forces Europe 
FPO New York 09501 


Commander in Chief 
U. S. Pacific Fleet 
FPO San Francisco 96610 


Commander in Chief 
U. S. Southern Command 
APO New York 09826 


Commander Middle East Force 
FPO New York 09501 


Commander Naval Air Force 
U. S. Atlantic Fleet 
Naval Air Station 
Nomeelie Virginia 23511 


Commander Naval Air Force 

U. S. Pacific Fleet 

Box 1210 

Naval Air Sta., North Island 
San Diego, California 92135 


Commander Patrol Wings Atlantic 
Naval Air Station 
Brunswick, Maine 04011 


Commander Second Fleet 
FPO New York 09501 


Commander Seventh Fleet 
FPO San Francisco 96601 


Commander Sixth Fleet 
FPO New York 09501 


Commander Submarine Force 


U. S. Atlantic Fleet 
Nertoll, Virginaa 23511 


S07 





Eo. 


60. 


Gil. 


G2, 


ae 


64. 


Co. 


GG. 


67. 


68. 


Go. 


70. 


57020 


G99 26 


Doo 2d 


g992is 


57087 


00510 


65134 


revere 


coos 


63186 


99912 


99918 


Commander Submarine Force 
U. S. Pacific Fleet 
FPO San Francisco 96610 


Commander Submarine Group 5 
Fleet Station Post Office 
San Diego, California 92132 


Commander Submarine Group 7 
Box 50 
FPO Seattle 98762 


Commander Submarine Group 8 
Box 104 
FPO New York 09524 


Commander Third Fleet 
FPO San Francisco 96610 


Commander U. S. Naval Forces 
Southern Command 
FPO New York 09580 


Commander U. S. N. Element 
PACOMELINT Center 

BoxesZ25, Terminal Navy PO 
FPO San Francisco 96610 


Commanding Officer 
Fleet Composite Squadron 1 
FPO San Francisco 96601 


Commanding Officer 

Fleet Intelligence Center 
Europe and Atlantic : 
Norfolk, Virginia 23511 


Commanding Officer 

Fleet Intelligence Center 
Pacific 

BROsSan Francssce 96610 


Commanding Officer 

Fleet Intelligence Center Europe 
Box 18, Naval Air Station 
Jacksonville, Florida 32212 


Commanding Officer 

Fleet Intelligence Training 
Center Atlantic 

Bldg SP 234, NAS 

Nomtolke Varqinia 2351] 
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UNS 


eae 


73. 


74. 


Use 


76. 


UUs 


ve 


qo. 


80. 


Sete) 


93975 


99933 


60200 


99932 


63420 


66400 


68166 


63064 


Commanding Officer 

Fleet Intelligence Training 
Center Pacific 

Bldg 5, Fleet ASW School 

San Diego, California 92147 


Commanding Officer 
ELTCORGRU Two 

Naval Amphibious Base 
Little Creek 

Norecolk, Virginia 23520 


Commanding Officer 
Intelligence Center Pacific 
Box 2c 

FPO San Francisco 96610 


Commanding Officer 
Naval Air Station 
Cecil Field, Florida 32215 


Commanding Officer 
Naval Amphibious School Coronado 
Sane Diego, California 92155 


Commanding Officer 
Naval Command Systems 
Support Activity 
Washington Navy Yard 
Washington, D. C. 20390 


Commanding Officer 

Naval Intelligence Processing 
System Support Activity 

2461 Eisenhower Avenue 
Alexandria, Virginia 22331 


Commanding Officer 

Naval Intelligence Processing 
System Training Facility 
Naval Air Station Albany 
Albany, Georgia 31703 


Commanding Officer 

Naval Intelligence Support Center 
4301 Suitland Road 

Washington, D. €. 20390 


Commanding Officer 

Naval Investigative 
Service Office Hawaii 

Box 122 

FPO San Francisco 96610 
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ST. 


2, 


So. 


84. 


oon 


86. 


87. 


88. 


89. 


90. 


63055 


63053 


63057 


63058 


63285 


63054 


63051 


63126 


62769 


o992) 


Commanding’ Officer 

Naval Investigative 
Service Office Norfolk 

Norfolk, Virginta 23511 


Commanding Officer 
Naval Investigative 
Service Office NORLA 
I ), IWrase (sc Sys 
New Orleans, Louisiana 70174 


Commanding Officer 
Naval Investigative 
Service Office San Diego 
pe ©. Box 10666 
San Diego, California 92110 


Commanding Officer 
Naval Investicative 
Service Office San Francisco 
Building 7, Treasure Island 
San Francisco, California 94130 


Commanding Officer 

Naval Investigative 

Service Headauarters 

2461 Eisenhower Avenue 
Alexandria, Virginia 22314 


Commanding Officer 

Naval Investigative 

Service Office New York 
Flushing and Washington Avenue 
Brooklyn, New York 11251 


Commanding Officer 

Naval Investigative Service 

Naval Base 

Charleston, South Carolina 29408 


Commanding Officer 
Naval Missile Center 
Point Mugu, California 93042 


Commanding Officer [NS Subic] 
U. S. Naval Station 


. FPO San Francisco 96651 


Commanding Officer {[NISO Marianas] 
U. S. Naval Investigative 
Service Office 
Pee. Box wl64 
FPO San Francisco 96630 


S109) 





2A 


a2. 


23. 


94, 


oo. 


96. 


or 


OIG. 


oo. 


TOO . 


col, 


102, 


62856 


65493 


99920 


00309 


03366 


05840 


03364 


03365 


03342 


3359 


03321 


Commanding Officer [NAF Lajes] 
U. S. Naval Air Facility 
APO New York 09406 


Commanding Officer. [NIS Europe} 
U. S. Naval Investigative 
Service Office 
Box El 
FPO New York 09510 


Commanding Officer [NISO Japan] 
U. S. Naval Investigative 
Service Office 
Box 76 
FPO Seattle 98762 


Commanding Officer (NS GTMO} 
Ue S. Naval Station 
Box 25 


FPO New York 09593 


Commanding Officer 
USS AMERICA (CVA66) 
FPO New York 09501 


Commanding Officer 
USS BLUE RIDGE (LCC 19) 
FPO San Francisco 96601 


Commanding Officer 
USS CONSTELLATION (CVA 43) 
EPO San Francisco 96601 


Commanding Officer 
USS CORAL SEA (CVA 34) 
BPO San Francisco 96601 


Commanding Officer 
USS ENTERPRISE (CVAN 65) 
FRO San Francisco %96601 


Commanding Officer 
USS FD ROOSEVELT (CVA 42) 
FPO New York 09501 


Commanding Officer 
USS PORRESTAL (CVA 59) 
FPO New York 09501 


Commanding Officer 


USS HANCOCK (CVA 19) 
FPO San Francisco 96601 


Sab 





HO. 03362 Commanding Officer 
USS INDEPENDENCE (CV 62) 
FPO New York 09501 


104. C2267 Commanding Officer 
USS JOHN F KENNEDY (CVA 67) 
FPO New York 09501 


OS. Os36e Commanding Officer 
USS KITTY HAWK (CV 63) 
FPO San Francisco 96601 


106. 03341 Commanding Officer 
USS MIDWAY (CVA 41) 
FPO San Francisco 96601 


UG? 20001 Commanding Officer 
USSeMT WHITNEY (LCE 20) 
FPO New York 09501 


108. 03334 Commanding Officer 
USS ORISKANY (CVA 34) 
FPO San Francisco 96601 


109. O2261 Commanding Officer 
USS RANGER (CVA 61) 
FPO San Francisco 96601 


110. 03360 Commanding Officer 
USS SARATOGA (CV 60) 
FPO New York 09501 


A. 64591 Deputy Director 
Strategic Target Planning 
Offutt Air Force Base 
Nebraska 68113 


qa. 99943 Director 
Defense Intelligence Agency 
(Alternate National Military 
Command Center) 
Washington, B. C. 20301 


a3. 99940 Director 
Defense Intelligence Agency 
{Arlington Hall Station) 
Washington, Ds €. 20301 


a4. 99945 Director 
Defense Intelligence Agency 
(Canadian Defense Headquarters) 
Washington, D. C. 20301 


gee 





iS 


116. 


LIF - 


oie. 


oo. 


120, 


Zi. 


22°. 


eS: 


124. 


99944 


99942 


99933 


99941 


SGI's 


30883 


OO O17 


66600 


66842 


Director 

Defense Intelligence Agency 

(National Emergency 
Airborne Command Post) 

Washangton, speec. 20301 


Director 

Defense Intelligence Agency 
(National Mil Intell Center) 
Washington, D. C. 20301 


Director 

Defense Intelligence Agency 
(National Security Agency) 
Washington, D. C. 20301 


Director 

Defense Intelligence Agency 
(Pomponio Plaza) 
Washington, Dp. C. 920301 


Director 

Defense Intelligence Agency 
(Washington Navy Yard) 
Washington, D. C. 20301 


DineceLor 
Defense Intelligence Agency 
Washington, D. C. 20301 


Director 

Naval Ocean Surveillance 
Information Center 

4301 Suitland Road 
Washington, D. C. 20390 


Officer in Charge 
EURFAST (TG168.3) 
Box 24 

FPO New York 09521 


Ofitcer sin Charge (FOSIF Rota] 

Fleet Ocean Surveillance 
information Paciiity 

FPO New York 09540 


Officer in Charge [FOSIC London} 
Fleet Ocean Surveillance 

Information Center 
FPO New York 09510 
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me 5. 


226. 


U27 


28. 


29, 


SO. 


66967 


66970 


99916 


62930 


Meee Ty 


e995 


Officer in Charge 

Fleet Ocean Surveillance 
Information Center 

NOttolk. Virginia) 235) 


Officer in Charge 

Fleet Ocean Surveillance 
Information Facility 

FPO Seattle 968768 


Officer in Charge 
LANTFAST (TG168.2) 
CINCLANT Compound 
Noriolk, Virginia 2351/1 


Officer in Charge 
Navy Field Operational 
Intelligence Office 
forte Ceorge G. Meade 

Maryland 20755 


Officer in Charge 

NFOIO (Friendship Annex) 
Fort George G. Meade 
Maryland 20755 


Officer in Charge 
PACFAST (TG168.1) 
CINCPACFLT, Box 14 

FPO San Francisco 96610 
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TABLE D-2 


List of Valid CONUS/OVERSEAS Codes 


The following lists and defines those values which were coded 


in card column 73 of the first card of the data base. VAROOS5 


we the variable number associated with this field. 


" Qo" 


" et 


Way 


" 3" 


A 


= command is located within the continental United 


States. 


command is located on the European continent or on 
land in proximity to the European continent 
(e.g., Iceland). 


command is located ashore in an area surrounding the 
Paciiic Ocean . 


command is an afloat command operating in either the 
Atlantic Ocean or the Mediterranean. 


command is an afloat command operating in the 
Paca tie Ocean. 
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TABLE D-3 


List of Valid State and Country Codes 


The following lists and defines those values which were coded 
in card columns 74-75 of the first card of the data base. 


VARO06 is the variable number associated with this field. 


"AF" = any afloat command 
"AK" = Alaska 

"AZ" = Azores 

"CA" = California 

"CN" = Nationalist China 
"CZ" = Panama Canal Zone 
"DC" = Washingtecn, D.C. 
"FL" = Florida 

"GM" = Guam 

"GT" = Guantanamo Bay, Cuba 
"HI" = Hawaii 

mic" = Iceland 

rrr" = Ttaly 

"JP" = Japan 

"KO" = Korea 

"LA" = Louisiana 

"MA" = Marianas Islands 
"MD" = Maryland 

"ME" = Maine 

"NB" = Nebraska 

"NY" = New York 

"PA" = Pennsylvania 

"PI" = Philippine Islands 
"PR" = Peurto Rico 

voc" = South Carolina 
foe" — Spain 


"TH" = Thailand 
"UK" = United Kingdom 


"VA" = Virginia 
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TABLE D-4 


List of Valid Researcher Code Numbers 


The following lists and defines those values. which were 


coded in card column 76 of the first card of the data base. 


VAROO7 is the variable number associated with this field. 


iT] st 
Ug) i 
Ww ai 
w 4" 


5" 


Lieutenant W. I. 


= Lieutenant N. M,. 


Lieutenant E. W. 


Lieutenant T. R. 


= Lieutenant Commander D. L. Mount 


Foster 
Bickell 
Huber, Jr. 


Watson 
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TAGE D=5 


List of Valid Respondent Rank Codes 


The following lists and defines those values which were coded 


in card column 41 of the second card of the data base. VARO11 


is the variable number associated with this field. 


wap 
ven 
oe 
tee 


"" 6" 


respondent was 
respondent was 
respondent was 
respondent was 


respondent was 


ea gi lian 

lieutenant (paygrade 0-3) 
lieutenant commander (paygrade 0-4) 
commander (paygrade 0-5) 


captain (paygrade 0-6) 
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TABLE D-6 


List of Valid Respondent Educational Level Codes 


The following lists and defines those values which were coded 


in card column 66 of the second card of the data base. VARO18 


is the variable number associated with this field, 


WW (gy 
ae 
ee 


wan 
"ow 


= respondent had less than a bachelors degree. 
= respondent had a bachelors degree or equivalent. 


= respondent had a bachelors degree plus some post- 


graduate studies, or equivalent, but did not have a 
masters degree or equivalent. 


respondent had a masters degree, or equivalent. 


respondent had a doctoral level degree. 


The Defense Intelligence School, or its predecessor the Naval 


Intelligence School, did not qualify under the definition 


given to a bachelors or masters level education. 
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TABLE D-7 


List of Valid Respondent Training Codes 


The following lists and defines those values which were coded 


in card columns 67-71 of the second card of the data base. 


VARO19 is the variable number associated with this field. 


LW 


Wu 


iT 3" 


Hi ah 


UU Tes 


Wg 


t ape 


" 8" 


we go" 


respondent had previous intelligence related experience. 


respondent had previous military experience (other than 
intelligence related). 


respondent had attended the Defense Intelligence School 
Or its predecessor, the Naval Intelligence School. 


respondent had photographic interpretation or photo- 
graphic experience. 


respondent had attended intelligence training courses 
such as those given at the Fleet Intelligence Training 
Centers or at Lowry Air Force Base. 


respondent had foreign Language training (source of 
the training was not important). 


respondent had automatic data processing experience or 
training related to automatic data processing. 


respondent had obtained professional military education 
(as opposed to civilian education), but no degree 
program was associated with the education. Examples 
included the various war and staff colleges. 


respondent had professional training (as opposed to 
education) other than intelligence related training. 
Exemples included nuclear weapons/nuclear technology 
training, the Fleet Anti-Air Warfare Training Centers, 
eter 
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TABLE D-8 


List of Valid Additional Output Codes 


The following lists and defines those values which were coded 


in columns 33-35 of cards four, five, and six, and in columns 


71-73 of cards four and five of the data base. VARO62, VARO65, 


VARO70, VARO73, and VARO78 are the variable numbers associated 


with these fields. 


ne 
ost 
wee 
oe 
one 
ten 
yet 
neti 
ned 
oe 


wy = 


Wo" 


oa8 
"OH 
foe 
niet 
ae 


= administration of an intelligence office. 


resource and organizational management. 
budgeting and fiscal planning. 
decisions and recommendations. 

briefs and debriefs. 

liaison, 

charts and audio-visual aids. 
counterintelligence studies. 

data analysis. 

estimates. 

intelligence annexeS to operation orders. 
intelligence collection plans. 
intelligence collection tasking. 
Intelligence Information Reports. 


interface with automatic data processing and 
telecommunications. 


orders-of-battle. 

physical security. 

tactical plots. 

non-intelligence related outputs. 


counseling and training. 
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TABLE D-9 


List of Valid Educational Level Rating Codes 


The following lists and defines those values which were coded 


for the interview and DELPHI QueSticnnaire educational profi- 


ciency level codes. Variable number associated with this 


coding scheme included: VARO87 through VAR132, VAR137 through 


VAR1L82, VAR213 through VAR272, and VAR278 through VAR343. 


Ww 


WW 


" Bu 


4s (| 


That academic pursuit was either not needed or not used. 


= That academic pursuit was required or used at a "Basic 


Knowledge" level, i.e., having general acquaintance 
with major concepts, capabilities, and limitations. 


That academic purSuit was required or used at a 
"Working Knowledge" level, i.e., sufficiently familiar 
to be able to communicate effectively with an expert 
regarding both a problem and a solution, but not 
necessarily able actually to work a complex problem 
without supervision and outside assistance. 


That academic pursuit was required or used at an 
"Expert or Theoretical" level, i.e., possessed 

knowledge which allowed one to conceptualize and 
execute the steps required to provide solutions. 
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TABLE D-10 


List of Valid Interview Data Academic Codes 


The following lists and defines those values which were 
used in various data fields to represent the different educa- 
tional areas. The first two digits represented a general 
academic pursuit and the single digit after the decimal point 
represented a specific subset of the associated academic 


pursuit. 


Mathematics Series (01.x): 
01.1 College Algebra 
O22 Beginning Calculus 
01.3 Probability and Statistics 
01.4 Advanced Calculus 
Foreign Language Series (02.x): 
02.1 Foreign Language (language not specified) 
Area Studies (03.x): 
i3.. USSR 
03.2 Peoples Republic of China 
03.3 Middle East 
03.4 Europe 
03.5 Latin America 
3.6 Africa 
Operations Analysis Series (04.x): 
04.1 Operations Analysis 


International Relations Theory (05.x): 


05.1 International Relations 
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Naval Science Series (06.x): 


06.1 
06.2 
OG. 3 
06.4 
06.5 
06.6 
OG. 7 


National 


O7 51 
O72 
G7 23 


Soviet Fo 


Oeseal 
08.2 
en 
08.4 
03.5 
08.6 


Underwater Acoustics 
Sonar Systems 
Communication Systems 
Radar Systems 

Optics 

Lasers 

Collection Systems 


Security Series (07.x): 


National and Naval Budgetary Process 
Threat and Net Assessment 
National Security and Intelligence Organization 


rees Studies (08.x): 


Naval 

Air Force 

Ground 

PVO 

Strategic Rocket Troops 
Merchant/Fishing/Oceanographic Operations 


Blue Forces Studies (09.x): 


co. 1 
09.2 
Oe eg: 
09.4 


Automatic 


Oy 
Oe 2 
O23 
10.4 


Communica 
or) 


el 2 
1) Le 


Collection Systems 
Naval Forces 
Non-Naval Forces 
Allied Capability 


Data Processing Series (10.x): 


System Design/Analysis/Management 
Hardware Operations 

Software Operations (Programming) 
Basic Interface Operations 


f10n Skills (11 .x): 
Briefing 


Writing 
Organization of Thought 


Management Series (12.x): 


Jha 
M22 
2.3 
2 54 
2 
i226 


Collection Systems 

PERT 

Management by Objectives 
Personnel 

Financial 

Labor Relations 
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APPENDIX E 
BASIC DATA BASE FILE STRUCTURE, INCLUDING THE 
ALGOL/FORTRAN LINKAGE, ANCILLARY DATA BASE FILES, 


DATA FILE VALIDATION, AND THE DATA FILE 
GENERATION CHRONOLOGY 


BASIC DATA BASE FILE STRUCTURE 


A. UNIFORMITY IN THE VARIABLE LABELLING SYSTEM 

One of the advantages in having chosen the Statistical 
Package for the Social Sciences [SPSS] analysis programs was 
the ease of labelling the variables. All variables were 
assigned a sequential number to identify each field within 
the input stream. AS an example, the first variable was 
VAROO]L, followed by VARQ02, etc. Even though there was no 
immediate correlation between the variable label and the 
meaning of the variable, there were inherent coding advantages. 
Two advantages were the simplified variable declaration 
statements required by SPSS, and a relative chronological 
and spatial connotation within the data base. 

In order to make as uniform a data base Structure as 
possible, this sequential variable coding scheme was maintained 
throughout all programs with only one slight modification. 

The ALGOL compiler did not recognize differences in a numeric 
card image input efeigeenn unless there was at least one blank 
Space between fields. To conserve data card space, blank 


spaces between numeric fields were not included. To alleviate 
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this problem, the ALGOL input Stream was read as an 80 column 
alphanumeric stream and then each numeric field was converted 
character-by-character from its alphabetic decimal representa- 
tion to its numeric integer equivalent. In general, both the 
alphabetic version and the numeric conversion of each trans-. 
formed variable were in core Simultaneously. The numeric 
version retained the “standardized" variable label similar 

to the SPSS definition, i.e., VARO043 was a numeric variable 
in both the SPSS definition and the ALGOL data definition 
module. The unconverted alphabetic input stream variables 
were Similarly numbered, but appended with the letter "A", 
i.e., the variables’ alphanumeric version. Alphabetic 
variables required no conversion and no “A" was appended to 
the variable lahel. Hence, VAROO] was an alphabetic variable 
in both SPSS and in ALGOL; VARO43 was also a numeric variable 
in both SPSS and in ALGOL, but VARO43A was the ALGOL uncon- 


verted alphanumeric equivalent of the ALGOL variable VARO043. 


B. THE DATA BASE MODULE 

Numerous references are made to the ALGOL data base 
definition moduie. This module was simply the collectivity 
of the standardized variable declarations used throughout all 
ALGOL source programs. The initial data base declaration 
cards were physically reproduced and inserted in each program 
which accessed those data cards — another step toward uniform- 


ieeehrougnout the entire project . 
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C. THE BASIC DATA BASE DECLARATION MODULE 

To generate the initial data base file, the first iteration 
of DELPHI A, dated 19 August 1974 [Appendix B, Sample A], was 
transferred, field by field, to the coding Sheet exhibited in 
Appendix B, Sample B. Data control and coder information 
variables were added to make the data base fully responsive 
to any form of data retrieval and to allow for regeneration 
in case of catastrophic failure. The most important control 
variables were the Sequence or caSe number, and the card 
number. These two variables were punched in columns 77-79 
and column 80, respectively, in each card to allow for card 
sorting and caSe identification. This initial questionnaire 
consumed seven cards; these seven cards became the basic data 
base. They were then mechanically sorted in ascending order 
by card number within sequence number and then placed on the 
Model 2311 disk for validation, printing, and analysis. This 
file of seven cards per caSe was labelled QCARDS for JCL 
purposes. Appendix D contains a list of the types of informa- 


tion coded for each variable. 


D. SPECIAL CODING CONVENTIONS FOR CERTAIN ALPHABETIC FIELDS 
Several variables were deSigned and coded specifically 

for the purpose of using the upper and lower printing capa- 

bility of the Model 1403 high speed chain printer. The Text 

Processing System (TPS) program subroutines mentioned previously 

were designed to facilitate this printer option. In order to 


key certain special operating parameters and to control 
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upper/lower case printing, TPS reserved several seldom used 
characters for internal flagging. Of coding interest were 
the "/" and the "=" characters. The "/" was the special flag 
to shift printer case; if the "TN" print chain were set to 
lower case, then a "/" immediately preceding a letter shifted 
{only} that next letter to upper case, and vice versa. The 
"-" character was utilized in conjunction with specified one 
or two character fields to control printer operating param- 
eters. To take full advantage of the TPS program, these 
special characters had to be used judiciously. 

The “=" character was excluded entirely from uSe in the 
following alphabetic fields: VARO01 (command name), VARO03 
(billet title), VARO10 (respondent's name), VARO61 (first 
additional output wording), VAROQ64 (second additional output 
wording), VARO69 (third additional output wording) , VARO72 
(fourth additional output wording), and VARO77 (fifth addi- 
tional output wording). | 

The respondent's name, VARO10, was especially coded to 
include the "/" character. BecauSe some ee CARS submitted 
only their last names and since some last names were two 
separate words, some means for controlling "non-standard" last 
name situations also had to be included in the coding scheme. 
It was decided that a "#" character would be used as the flag 
to indicate that the name variable contained only the 
respondent's last name, or that a double-worded last name 


existed. Surname suffixes were included on several of the 
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questionnaire forms. Hence, “Jr.", "II", and "III" were also 
included in the name variable. For these reasons, coding all 
the possible name permutations (VARO10) became a programmer's 
nightmare. The best way to explain this soanne scheme is to 
provide several examples to show the different formats. A 
"Standard" name was coded thus: "/JOHN /T. /JONES"; 


"non-standard" name examples are: 
/JOHN /T. /JONES, nee 
Jie flee ONES; /i/ 1/1, 
#/JOHNSON, 
/J. /T.#/MC /DONALD, 
[ian 34 / Nee eEOO,. 7/171, and 


#/MC /DONALD. 
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ALGOL/FORTRAN LINKAGE UNDER OS360/MVT CONTROL 


A. BACKGROUND 

One of the accomplishments of this project was the 
successful, extenSive use of linked ALGOL W programs with 
FORTRAN subroutines in execution core of the 360 computer. 
The need for this unuSual arrangement arose from inherent 
limitations in the Stanford University version of the ALGOL 
compiler, which was available at the Naval Postgraduate 
School. The Stanford version of the ALGOL compiler was the 
16 January 1972 version, as modified for local operating 
conditions, and was used throughout the project. Further use 
of the words ALGOL, ALGOLW, ALGOLX, and ALGOLY refer to that 
specific compiler. 

A detailed description of the procedures to be followed 
and the limitations on such linkages are provided. The 
discussion applies specifically to the Naval Postgraduate 
School computer installation and presumes the reader is 
familiar with: (a) the IBM OS360/MVT operating environment, 
ieee, JOD control language [JCL]; (b) the Standard IBM 
FORTRAN IV compiler; and (c) the Stanford ALGOL compiler. 
The reader is directed to the ALGOL W Reference Manual by 
Sites, pages 107 through 110.3 for a refresher in general 
ALGOL linkage design. The following discussion and Figure E-1l 
draw heavily upon that reference as well as the experience 


gained in the operationalization of the linkages. 
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PICURE Ba1 
ALGOL COMPILE/LINK-EDIT/GO SEQUENCE 


ALGOL 
SOURCE 
DECK 


ALGOLY 


COMPILER 


OTHER ALGOL 
ALGOLX 0S/360 AND/OR 
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MONITOR DECK OBJECT DECKS 


ALGOLW 
LIBRARY : 
0S/360 
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0S/360 


oD 


EXECUTION 
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B. SUMMARY OF THE ALGOL LINKAGE DESIGN 

There are two versions of the ALGOLW compiler; both use 
exactly the same execution code for the various phases of 
the compiler and for the run-time library. However, the 
monitor phase [ALGOLX] is slightly different for the two 
execution modules. The compile/load/go in-core version is 
called ALGOLW and is not the version which allowed for linkage 
with the separately compiled ALGOL or FORTRAN object decks. 
The compile only version [ALGOLY] produces a standard 0S/360 
object deck only and is the version used to allow for a 
linkage. In fact, this object deck output from ALGOLY can be 
link-edited with other object decks produced by other ALGOLY 
compilations as well as by standard FORTRAN IV compilations. 
In order to be executable, the object decks must be link- 
edited with the ALGOL library, the ALGOL run-time monitor 
{[ALGOLX], and, if FORTRAN object decks are co-link-edited, 
the FORTRAN library. This arrangement is depicted graphically 


in Figure E-1l. 


C. THE LINKAGE PROBLEM 

This computer/ALGOL combination installation suffered 
from a JCL inability to pass correctly more than a single 
ALGOLX monitor control parameter [such as ALGOL execution 
time limits (PARM.GO='TIME=5'), ALGOL printed page output 
limits (PARM.GO='PAGES=15'), or ALGOL execution-time core 
Size availability (PARM.GO='SIZE=200K')] to the "GO" step as 


outlined in the reference manuals. Additionally, the format 
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was not as provided in the reference manuals, but rather as 

shown in brackets above. Each reference to time, page, and 

size limitations refers to the ALGOLX monitor limits and not 
to those of the normal OS360 limits. 

The ALGOLX 'SIZE' parameter had to be overridden in almost 
every program written for this project because the ALGOLX 
monitor requests its full default value for core storage 
{nominally 120K] from the O0S360 operating system in the "GO" 
step. ALGOL never "knows" how much core storage will be 
required in the execution phase until it is needed. This 
dynamic core allocation scheme became a Nemesis which resulted 
from having chosen ALGOL's expanded alphabetic string manipula- 
tive ability. The 0S360 allocation sequence is as follows: 
first to the object deck(s) [ALGOL and/or FORTRAN], second 
to ALGOLX for operating core storage space [for which ALGOL 
takes all remaining core storage up to the JCL limit], and 
finally to the FORTRAN deck for input/output buffer space. 
Since there can never be any remaining core storage for the 
Patra allocation step, me result is an 0OS360 error message 
which indicates insufficient core availability. Unless and 
until ALGOL is restricted in its bid for core storage, FORTRAN 
input/output buffer space will never exist. This is the 
reason for the 'SIZE' parameter in ALGOL. A problem would 
not have existed locally had the installation JCL been able 
to pass the 'SIZE' parameter information correctly into the 
"GO" step. This it could do only if there were one parameter 


to be passed. 
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D. THE LINKAGE PROBLEM SOLUTION 

It was necesSary to override both "TIME! ana “SIZE ' 
default parameters in ose every program. To circumvent 
this local deficiency, a Special ALGOLX monitor was created 
in which the ALGOLX monitor time control functions were 
completely disabled. This version of the monitor was stored 
semi-permanently on disk storage. AI.GOLX monitor page 
limitations [nominal default is nine pages] never presented 
a problem because there never wasS a need for both the 'SIZE' 


and the 'PAGE' parameters to be overridden in the Same program. 


E. INPUT/OUTPUT STANDARDIZATION 

In order to simplify the increasingly complex job control 
language, ALGOLX monitor situation, and the ALGOL/FORTRAN 
interfacing, a Standardized FORTRAN IV G source deck was 
compiled and the object deck was placed on the SYS003 data 
disk. This FORTRAN source deck is shown as Figure Ee ee 
Eeomltang Object deck, called FOALG3 [FORTRAN Object deck for 
ALGOL programs, version 3], was then used uniformly Enroughieue 
the computerization process. FOALG3 had the ability to read 
three different input files from any medium ["READ1]1", "READ12", 
and "READ13"], to write three different output files on any 
Meauam ["“RITEl4", "RITEIL5", and "RITE16"], to rewind each of 
those six logical files ["RWND11", "RWND12", "RWND13", "RWND14", 
"RWND1L5", and "RWND16"], and to punch cards [“PUNCH"]. Without 
exception, all images that were passed between the ALGOL source 


programs and the FORTRAN subroutines were 80 alphanumeric 
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PICURE EZ 


FORTRAN SOURCE PROGRAM FOR 
STANDARDIZED INPUT/OUTPUT FUNCTIONS 
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FIGURE E-2 (Continued) 
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characters in length. Blocking factors were usually 45:1 
which resulted in a 3600 character block Size, the maximum 
allowable for a Model 2311 disk. The 10:1 block size for the 
Standardized FORTRAN subroutine object deck es 800 characters 
of binary information, the maximum allowable by the 0S360 
link-editor program. 

Advantages of standardization of all input/output functions 
included: less chance for error in program loading and less 
time required to read source and object decks at the card 
reader. One disadvantage of FORTRAN output under ALGOLX 
control was the inability to close an output file automatically 
after main program termination. Several solutions were avail- 
able. The most commonly uSed approach was to output a suffi- 
Seewewiumoer Of blank dummy records just prior to ALGOL 
termination, thereby forcing any partially filled buffer 
records onto the output medium. A secondary method was to 
reduce the block size to equal the record length [i.e., 80 
characters]. This prevented the problem entirely but was 
wasteful of disk storage space. More exotic methods could 


have been pursued had time permitted. 


F, THE GO.FTO7FO001 DILEMMA 

One curious aspect of this functional bootstrap approach 
to input/output was an inconsistent request by OS360 for a 
GO.FT07001 data definition card. Even though very few programs 
called on the FOALG3 subroutine PUNCH, more often than not 


Spurious O0S360 error situations and messages were produced and 
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program execution terminated. The only remedy taken was to 
add the standard, but "unneeded", GO.FTO7F001 data definition 


card and reStart. 


G. EXAMPLE JCL DECK 

A sample JCL deck including the ALGOL/FORTRAN linkage is 
explained here. It was used in the generation of the computer- 
printed DELPHI Questionnaire dated 6 November 1974. The input 
files were the data base cards [QCARDS] on file 11, the 
formatted basic letter control deck [DEL1TPS] on file 12, and 
the address label card file [MAILER] on file 13. The output 
files were the tailored letter in TPS format on file 14, the 
large address labels on file 15, and the small address labels 


on file 16. No cards were punched in this program. 


SAMPEE SUCHE DECK SET-UP 


//HUBER3 JOB {2b00,0678,YS4e},'HUBER.E.W.',TIME=40 


© 


// EXEC ALGUCLG.PARM.GO='SIZE=220K' 1REGION=37SK 
//ALGOL-SYSIN DD x 


(2) — ZALGOL 
SSS remainder of AT,GOL source deck here ----- 
/* 
G) //LINK.SYSLIB DD UNIT=2314,VOL=SER=DUFFY .DISP=SHR 4 
CG 7 DSN=S2b00-ALGOLU 
G) LE DD DISP=SHR«DSN=SYS3-ALGOLU,UNIT=23214 4 
G@)  // VOL=SER=LINDA 
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goo, © 


// 


DD DISP=SHR4DSN=SYS1L-FORTLIB 


//LINK-SYSPRINT DD DUMMY 


//LINK~SYSIN 
tAde 
// 
/* 
//GO.FTLLFOOL 
// 
// 
//GO0.FTIeFOOL 
// 
// 
//GO0.FTL3FO0L 
// 
77 
//G0-FTLYFOOL 
ais 
7 / 
// 
//G0.FT1LSFOOL 
// 
Uf 
Mag 
//GO.FTLLFOOL 
// 
// 
// 


DD 


DD 


DD 


DD 


DD 


DD 


DD 


UNIT 2311 ,VOL=SER=SYS003,DSN=S2b00-.FOALG3,4 
DeEB-{kEGEN-FBsLREGL-S04BLKSE7E-e00) 4 


DISP=SHR LABEL={44.,IN} 


UNIT=2311,VOL=SER=SYSO03,DISP={0LD.KEEP} 4 
DCB={RECFM=FBiLRECL=480 1BLKSIZE=34L00} 
LABEL=(44,,IN} .DSNAME-SebOO0- QCARDS 
UNIT=e€311,VOL=SER=SYSO03 .DISP={OLD KEEP}, 
DCB={RECFM=FB,LRECL=80 . BLKSIZE=34L00} . 
LABEL=f1.55,IN}4DSNAME=SebO00.DELLTPS 

UNIT =eSiiiaw OL =SER=S YSUDASDISP=LOLDGREEPTs 
DCB={RECFM=FB,LRECL=80 ,.BLKSIZE=3L00F5 
LABEL=14,,IN},DSNAME=S2b00-MAILER 

UND T=eseloVOb=SER=CELBOS.DISP={NEWSKEEP? « 
DOBStREG! M=FEaERECE=S05BLKSIZE=cUb0e 5 
DSNAME=S2bOO.TPSOUTISPACE={£CYLifeS0,10F35 
PABEL-RETPD=38 
UNIT=2311.,VOL=SER=SYS0O03.DISP={NEW.KEEP} 4 
DCB={RECFM=FB,LRECL=860,BLKSIZE=3b0015 
DSNAME=S2b00.BIGLBLSiSPACE={CYLifSicht}, 
EPABEE-=REnPD-30 

UNIT=231 .VOL=SER=SYSO03.DISP={NEW.KEEP? 5 
DCB={RECFM=FB,LRECL=80 1BLKSIZE=3L00} » 
DSNAME=S2bOO.LTLLBLS.SPACE={CYLifS,c}}, 


UAGEE=KETPD=40 
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//GO-FTO?FOOL DD DUNNY 
//G60.SYSIN DD * 
/* 


Notice that ALGOL was restricted to 220K bytes of core storage, 
but that the entire "GO" step had 375K, a difference of 155K 
bytes for the exclusive use of FORTRAN [cf. fields in the 
execute card highlighted number Q@ le NExXt) notice Ehat 10 
ALGOL control parameters were included on the "SALGOL" card 
because in the compile/load/go version of ALGOLY, there is no 
communications link between the compile step and the go step. 
The purpose of the PARM.GO parameter is to supplant that 
communications link for the ALGOLX monitor communications 
function. The two cards highlighted number G3) point the 
0S360 link-editcr to the modified ALGOL monitor package which 
had the execution time control function completely disabled. 
The two cards following that point the link-editor to ALGOL 
library which was included in the execution module. Card G) 
pointed the link-editor to the FORTRAN library for the FOALG3 
Subroutine used in the execution phase. The last three cards 
labelled G) caused the FOALG3 object deck to be included in 
the load module also. The remaining definition cards were in 
the standard JCL format defining the various input and output 


files. 
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ANCILLARY DATA BASE FILES 


Numerous ancillary files were generated throughout the 
project either to provide administrative project support or 


to extend the data actually contained within the data base. 


A. TRAINING CARCS [NAMED TCARDS FOR JCL PURPOSES] 

The TCARDS file contained the one to five numeric 
character training utilization codes mentioned applicable 
to VARO19. A breakdown of the meaning of various codes is 
provided in Appendix D Table D-7. The format for these cards 
was the sequence (case) number in card columns 1-3, one blank 
column, a quote character in column five followed by up to 
five single digit numeric codes, and then a closing quote 
character immediately behind the last numeric character to 
indicate the end of that input String. Only one case number 
was punched per card and only those cases with training 
information were included in this file. Three examples of 


meecords in this file are: 


A Mal 
A ilate 
Aye 03 7h 


This file of training information was preceded by a single 
card which had the Barber of training cards included in the 
TCARDS file punched in card columns 1-3. The TCARDS file was 
physically sorted in ascending case order prior to having been 


placed on disk storage. 
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B. ADDITIONAL OUTPUT CARDS [NAMED ACARDS FOR JCL PURPOSES] 
The additional output coded ACARDS file contained the one 
to three alphabetic character additional output code breakdown 
[Appendix D Table D-8] applicable to variables VARO62, VARO65, 
VARO70, VARO73, and VARO78. The format for these cards was 
sequence (case) number in card columns 1-3, one blank column, 
a literal 32 character transcription of the respective addi- 
tional output in word form from variables VARO61, VARO64, 
VARO69, VARO72, and VARO77 which had been excised earlier by 
a special card punch program, one blank column, and then up 
to three single character alphabetic codes representing the 
coded breakdown from Appendix D Table D-8 beginning in column 
38. Up to five different ACARDS could have been produced per 
case, one to match each possible additional output which may 
have been added by the respondent. Those cases which had no 
additional outputs required no ACARDS entry in this file. 


Four examples of the records on this file are: 


200 CURRENT INTEL (OPINTEL) PRODUCTN BDI 


201 COUNSELING SUBORDINATES al 
201 ESTABLISHING REQUIREMENTS B 
204 PHOTOGRAPHIC SUFPORT ABF 


This group of additional output codes was preceded by a single 
card which had the number of additional output cards included 
in the ACARDS file punched in card columns 1-3. The ACARDS 
file was sorted in ascending sequence prior to having been 


placed on disk storage. 
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C. MAILING ADDRESS CARDS [NAMED MAILER FOR JCL PURPOSES] 

The mailing address MAILER card file contained from one 
to five cards for each Unit Identification Code (UIC) [VAR004} 
and provided the mailing address used for that UIC. The 
format for the cards in this file was the UIC right-justified 
with leading zeroes in card columns 1-5, a single numeric 
character in column six referencing the card number within 
that UIC's address (only one through five were valid entries 
in that field), and the address line began in column eleven. 
Columns seven through ten were blank. The maximum allowable 
line length was 45 alphanumeric characters. Because the 
address file was used in the same special TPS printing program 
similar to the respondent's name field, it too was coded with 
the special control parameters for upper and lower case 
printing. An example of a record on the MAILER file for 


UIC 00015 was: 


000151 /COMMANDER 


000152 /NAVAL /INTELLIGENCE /COMMAND 

000153 /NAVAL /INTELLIGENCE /COMMAND /HOTRS 
000154 2461 /EISENHOWER /AVENUE 

00C155 /ALEXANDRIA, /VIRGINIA 22331 


To signal the last record on the MAILER file, a control card 
was added immediately after the last card of the last address 
record with the numbers "999999" punched in card columns one 
through six. This file was sorted in ascending line number 
order within UIC numbers prior to being placed on disk 


storage, 
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D. INTERVIEW DATA CARDS [NAMED ICARDS FOR JCL PURPOSES] 
Information coded from the interview data was punched 

into cards with only one educational area coded per card. 
The coding form used for the card file is shown in Appendix B 
Sample D. Because the majority of interview cases resulted 
in a few and variable number of academic requirements, it was 
Sasier for card punching reasons to submit only those fields 
actually needed or used. A maximum of 46 ICARDS could have 
been coded for each interview, one corresponding to each 
academic area. Although the coding scheme appears rather 
complex, it should be apparent that it was actually very 
Simple. Card columns 1-3 contained the case number, column 
four indicated the researcher primarily responsible for having 
coded the interview data, columns 5-7 contained the academic 
code from Appencix D Table D-10, column eight contained a 
emgage numeric digit ("1", "2", “3", or "4" from Appendix D 
Table D-9) which indicated the educational proficiency level 
used in the interviewee's billet, and column nine contained 
a Similar digit which tnavested the proficiency needed for 
that billet. Three sample ICARDS records are shown below: 

200201122 

200201313 

200202113 
The last card in the ICARDS file was a dummy end-of-file 
indicator with "999999999" punched in column 1-9. This file 
was sorted in ascending order by case number prior to being 


placed on disk storage. 
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E. MERGED QUESTIONNAIRE/INTERVIEW FILE 
[NAMED QICARDS FOR JCL PURPOSES] 


The basic questionnaire file, i.e., the seven card data 
Rise file aiready defined as the QCARDS, was merged with 
transformed ICARDS file data to form the QICARDS file. This 
file represented the original data collected from the initial 
19 August 1974 questionnaire and the interview data collected 
during the September interviews. The QCARDS were unchanged. 
The ICARDS were transformed by - matrix manipulation ALGOL 
source program into two card images; the first card image 
contained a 46 character string of numbers that represented 
the educational proficiency used by each interviewee with 
control information in columns 74-80, the second card image 
was Similar to the first except that it referred to the educa- 
tional proficiency needed by each interviewee and with a 
Slightly different code in the Pato block was in the 
following format: column 74 contained the coder number of 
the researcher having primary responsibility for the interview 
data; columns 75-76 contained a sub-card number, "01" for the 
first card and "02" for the second card; columns 77-79 
contained the ubiquitous sequence number; and column 80 
contained the cerd number which was an "8" in all instances. 
All appendages to the basic data base QCARDS files were 
numbered as card number eight; the sub-card numbers in columns 
75-76 were then utilized to differentiate between all of the 


appended cards. This sub-card number scheme was used 
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throughout the remainder of the computerization process. 


The first four QICARDS appeared thus: 


pas 3200 TV 22 220132334 3333433332323333311333 2012008 
213134 4442232333322434444444444444434444433444 2012008 
elminesec 2 VUE ie 2232322224321 31323333212322 2012018 


3131344332233223111334343333443242434444334433 2022018 


with the intervening seven QCARDS for case number 200 
immediately preceding the first group and the seven QCARDS 
for case number 201 immediately preceding the second group. 
Coder number two applied in both of these examples. No 
interview data was specified by a string of 9's in colums 
1-46, a nine in colum 74, and the remainder of the control 
block information in the standard format as described above. 
Since these two cards became part of the permanent data 
base file, the individual variables of each card were assigned 
sequential variable numbers similar to those assigned for the 
QCARDS file. Valid educational proficiency levels is presented 
in Appendix D Table D-10. QCARD variables (087 through 186) 


are listed as declared in Appendix D. 
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Meelis TEXT PROCESSING SYSTEM (TPS) FORMATTED LETTER 

FOR THE 6 NOVEMBER 1974 COMPUTER GENERATED DELPHI 

QUESTIONNAIRE [NAMED DEL1TPS FOR JCL PURPOSES] 

The control deck utilized to produce the computerized 
tailor-made DELPHI Questionnaire dated 6 November 1974 (refer 
to Appendix B Sample E) was written using normal TPS formatting 
instructions. A copy of general TPS instructions is included 
in Appendix F Sample F. The two minor modifications made in 
this input stream were: (a) the restriction of the formatted 
statements to card columns 11-80, and (b) the addition of 
sequenced parameters in columns seven through ten which were 
used for passing control information between the data base 
program and the TPS printing input file. During the planning 
Stage, the amount of control space required was unknown, so 
ten characters were set aSide. These were the 
columns of the card. An asterisk in column ten was the signal 
to transfer program control to the data base program (written 
in ALGOL with FORTRAN input/output subroutines), either to 
insert or to delete information. A three digit number pre- 
ceding the asterisk was a specified "programmed block number" 
used to tell the ALGOL source program what functions were to 
be performed. A listing of the DELITPS card file is in 
Appendix F Sample H. 

G. THE 6 NOVEMBER 1974 DELPHI CARDS 
.[NAMED D1LCARDS FOR JCL PURPOSES] 
The data resulting from the 6 ‘eae 1974 DELPHI Question- 


Nniare concerning intelligence related outputs was keypunched 
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directly from the response form provided to the respondent 
[Appendix B Sample EJ]. A control block of information similar 
to that on the QICARDS was added. After having merged the 
QCARDS and the DICARDS to produce the QICARDS file, a second 
merging program was executed to append the DICARDS, thereby 
producing the QIDICARD file which was the input file for an 
SPSS analysis program. The DICARDS format was 20 three digit 
fields beginning in card column one, each field corresponding 
to the revised intelligence related outputs' a flag code in 
column 72 designated the case as requiring Specialized exter- 
nal handling [usually as a result of the respondent having 
changed billets since the previous questionnaire was received]; 
the answer to the Defense Intelligence School graduate question 
in column 73; a code signifying receipt of the DELPHI Ques- 
tionnaire in column 74; and the sub~block of control informa- 
tion also included. The same list of educational proficiency 
codes contained in Appendix D Table D-10 applied to these 
variables as those contained in interview ICARDS file. The 
D2CARDS were mechanically sorted in ascending order by sub- 
card number within case number prior to having been placed 
on disk storage. The merged questionnaire OCARDS, interview 
ICARDS, first DELPHI DICARDS, and these second DELPHI D2CARDS 
were called the QID12CDS for JCL purposes. 

Again, aS an input into the data base file, each variable 
in this D2CARDS file was numbered in the standard cornee 
These variable declarations are listed in Appendix D (VAR213 


through VAR347). 
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H. THE 17° DECEMBER 1974 DELPHI CARDS 
[NAMED D2CARDS FOR JCL PURPOSES] 


Information returned in the 17 December 1974 DELPHI Ques- 
tionnaire concerning educational proficiency levels was key- 
punched directly from the response form supplied to the 
respondent [Appendix B Sample C]. Two cards per response 
were generated for data base use. The first card contained 
educational proficiency information for the three college 
algebra entries fused, needed, and future educational pro- 
ficiency poceet through the three entries for naval science 
collection systems levels. Another special case flag field 
was also added to this card as well as the block of control 
information similar to previous cards. The second card in 
this file contained the three entries for educational pro- 
ficiency in national security/threat/net assessment through 
the remainder of the form, i.e., organization of thought, with 
the card number ("03"), the Sequence or case number, and the 
card number as usual in columns 75-80. 

Again, because this information was an input to the data 
base file, each variable was numbered in the standard format 
as designated and listed in Appendix D (VAR 187 through 


VAR 212). 
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DATA FILE VALIDATION 


A. QCARDS VALIDATION 

An ALGOL source program was written to make exhaustive 
reasonability tests on those QCARD variables which could be 
tested. If minimum or maximum values were exceeded or if 
values did not correlate with other variables, an error 
message was produced. The input file was the QCARDS file 
and the program's output was a sequential listing of error 
messages. This program, named VALIDATE for JCL purposes, 
is listed in Appendix F Sample P; a sample output from the 
VALIDATE program is also given. The following is a list of 
variables and the reasonability limits used against those 
variables. 

1. VAROO4 (Unit Identification Code) had to be one of 
those specified in Appendix D Table Del. 

2. VAROO5 (CONUS/OVERSEAS CODE) had to be one of those 
lsited in Appendix D Table D-2. 

3. VAROO6 (State/Country Code) had to be one of those 
listed in Appendix D Table D-3. 

4. VAROO7 (Coder Number Code) values were arbitrarily 
assigned in the manner shown in Appendix D Table D-4. Further, 
the five researchers were assigned a block of two hundred 
sequence or case numbers (VARO08, etc.). LCDR Mount was 
aeeroned 001 through 199; LT Foster, 200 through 399; 


LT Bickeli, 400 through 599; LT Huber, 600 through 799; and 
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LT Watson, 800 through 998. VAROO7 was then verified by 
looking at the sequency number ee to the case as well 
as' being one of those values listed in Appendix D Table D-4. 
There were some cases which did not follow this coder/case 
number correlation scheme, but error messages were produced 
anyway just aS a reminder. 

5. VARO08/VARO23/VAR0O59/VARO67/VARO75/VARO81/VAR085 
(Sequence or case numbers for each of the seven card images) 
had to be the same throughout the entire case. This valida- 
tion test was the first to help in tracing down the situation 
where either too many or too few cards had been inserted for 
each caSe, a very important factor required in all subsequent 
computer programs. 

6. VAROQO9 (Card One Number) had to be a "1", 

7.  VARO11 (Respondent's Rank) had to be one of those 
values listed in Appendix D Table D-5. 

8. VARO12 (Respondent's Age) was tested for reasonability, 
i.e., between 30 and 55 years of age. 

9. VARO13 (Respondent's Present Designator) /VARO14 
(Respondent's Next Previous Designator)/VARO15 (Respondent's 
First Designator) variables were checked against the following 
st LO iis LUO ese 131s, 1s2x, 135“, lolx, 1ée3x, 
662x, 663x, 000x, and 999x. Although other designators were 
not necessarily invalid, it was decided that the majority of 
ami designators would pass the test against the above list. 
The fourth digit of the designator code was truncated prior 


to conducting the test. 


Sieak 





10. VARO18 (Respondent's Educational Level) was verified 
to be one of those values listed in Appendix D Table D-6. 

ll. VARO20 (Respondent's First Intelligence Billet Code) 
ecatO be a Oi or "Oo". 

12. VARO21 (Number Years Previous Intelligence Experience) 
was checked for limits of zero and twenty-five. 

13. VARO22 (Number of Months in Present Billet) was 
checked for limits of zero and 48 months. 

14. VARO24 (Card Two Number) had to be a "2", 

15. VARO25/VAR027/VAR029/VARO 31/VARO 33/VARO 35/VAR0 37/ 
VARO 39/VARO 41/VAR0 4 3/VARO45/VARO47/VAR049/VARO 51/VAR053/VAR055/ 
VAR057/VARO 63/VAR066/VARO 71/VARO74/VARO79/VARO80 (each of the 
various percentages of time Spent in each intelligence output) 
were summed and a warning message issued if that Sum were not 
equal to 100%. 

16. VARO26/VARO028/VARO30/VARO 22/VAR0 34/VARO 36/VARO 38/ 
VAR040/VAR042/VAR0 4 4/VAR0 46/VARO4 8/VAR0O50/VARO52/VAR0O54/VARO56/ 
VARO58 (each of the validity codes associated with the various 
intelligence output percent ences) had to be a TO") "lor. oO. 
Only one error message was issued regardless of the number of 
erroneous variables. 

17. VAROQ60 (Card Three Number) had to be a "3", 

18. VARO68 (Card Four Number) had to be a "4", 

19. VARO76 (Card Five Number) had to be a "5". 


20. VARO82 (Card Six Number) had to be a "6". 
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21. VARO84 (Comments Continuation Code) had to be a 
On’ , “iain oy a 2: 

22. VARO86 (Card Seven Number) had to be a "7". 

Some individual visual checking of variable values was 
included in this validation process. Corrections were effected 
by repunching the affected card(s). Upon completion of the 


validation the file was placed on disk Storage. 


B. TCARDS VALIDATION 

The TCARDS file was listed uSing autility print program. 
Validity was visually checked, card-by-card, against the 
original list from which the card were punched. Corrections 
were made by repunching the affected card(s). After valida- 


tion, corrected TCARDS file was placed on @isk storage. 


C. ACARDS VALIDATION 

The ACARDS file was also listed using a utility print 
program. It was visually checked for validity, card-by-card, 
against the original list from which the cards were punched. 
Corrections were made by repunching the affected card(s). 


The corrected ACARDS file was then placed on disk Storage. 


D. MAILER VALIDATION 

The MAILER file was listed using a utility print program. 
After a visual came awacered validity check, corrections were 
made by repunching the affected card(s). The corrected MAILER 
file was then placed on disk storage. Additional corrections 


were made after returns from some of the queStionnaires 


335 





indicated corrections and/or modifications were necessary. 
Every change in the MAILER file was followed by another card 


image to disk storage program. 


1B ¢ ICARDS VALIDATION 

The ICARDS file was listed using a utility print program 
and was visually checked for validity, card-by-card, against 
the original list from which the cards were punched. Correc- 
tions were made by repunching the affected card(s). After 
validation, the corrected ICARDS file was placed on disk stor- 
age. Additionally, the ALGOL source program which was written 
to insert the ICARDS file into the data base file performed 
validity checks against two different fields. First, each of 
the two Single character educational proficiency codes was 
checked to be sure it was one of those listed in Appendix D 
Table D-9. Also, the educational area codes were verified to 
be sure they were among those listed in Appendix D Table D-10. 
Additional corrections were made by repunching the affected 


card(s) and re-executing the ICARDS merger program. 


F. QCARDS REVALIDATION 

Upon completion of all of the above checks and at the time 
the OCARDS, the ACARDS, and the TCARDS files were merged, an 
ALGOL source program was executed. It rechecked and internally 
modified certain data fields. This step resulted in a more 
uniform data base structure and was necessary because of coder 


differences in instances where data was either missing or some 
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other anomalous situation existed. The merged QCARDS/ACARDS/ 
TCARDS file was machine punched into an updated "clean" data 
base QCARDS file. This new QCARDS file was then uSed in all 
Subsequent data base programs. 

The variables listed below were checked and modified as 
indicated. A lower case "b" represents an alphabetic blank 
character. 

1. If VAROO2 (Billet Sequence Code) was five blank 
characters, it was changed to "99999", 

2. If VARO11 (Respondent's Rank) was a "1" indicating a 
civilian, VAR013/VARO14/VARO0O15 (Designator Variables) were 
changed to "9999", 

3. I£ VARO14 (Respondent's Previous Designator) was all 
blank characters, then it was replaced with "9999", 

4. If VARO15 (Respondent's First DeSignator) was all 
blank characters, then it was replaced with "9999", 

5. If VARO16 (Billet Subspecialty Code) was "NONEb", 
then it was changed to "00000"; if VARO16 was "bbbbb" or NAbbb" 
then it was changed to "99999", 

6. If VARO1? (Respondent's Subspecialty Code) was "NONEb" 
then it was changed to "00000"; if VARO17 was "bbbbb" or 
"NAbbb" then it was changed to "99999", 

7. \VARO18 (Educational Level) was changed from a blank 
to Wg if necessary. 

8. VARO21 (Number Years Previous Intelligence Experience) 


was changed to "99" if the field was blank. 
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9. VARO22 (Number of Months in Present Billet) was changed 
fem 99" if the field was blank. 

‘10. VARO25/VAR027/VAR029/VARO 31/VARO 33/VARO 35/VARO 37/ 
VAR/039/VAR041/VAR04 3/VAR0O45/VAR047/VAR049/VAR051/VAR05 3/ 
VARO55/VARO57 (Percentages of time spent on various intelli- 
gence related outputs) each were changed to "999" if the field 
was all blank. 

11. VARO26/VAR028/VARO 30/VARO 32/VARO 34/VAR036/VARO38/ 
VARO40/VARO42/VAR044/VARO046/VARO04 8/VARO50/VAR052/VAR054/ 
VARO56/VARO58 (Validity of intelligence output codes) each were 
changed to "9" if the field were blank. 

12. If VARO63 (Percentage time devoted to first additional 
output) was blank, then it was changed according to the 
Bolevins test: if YARO61 (First Additional] Output Wording) 
was blank, then VARO63 was made "000", otherwise it was 
enanged to "999". 

13. If VARO66 (Percentage time devoted to second addi- 
tional output) was blank, then it was changed according to 
the following test: if VARO64 (Second Additional Output 
Wording) was blank, then VARO66 was made "000", otherwise it 
was changed to "999", 

14. If VARO71 (Percentage time devoted to third addi- 
tional output) was blank, then it was changed according to 
the following test: if VARO69 (Third Additional Output 
Wording) was blank, then VARO71 was made "000", otherwise it 


was changed to "999", 
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15. If VARO74 (Percentage time devoted to fourth addi- 
fiona l Beat) was blank, then it was changed according to 
the following test: if VARO72 (Fourth Additional Output 
Wording) was blank, then VARO74 was made "000", otherwise 
me was changea ta "999". 

16. If VARO79 (Percentage time devoted to fifth additional 
output) was blank, then it was changed according to the follow- 
ing test: if VARO77 (Fifth Additional Output Wording) was 
blank, then VARO79 was made "000", otherwise it was changed 
mem 999". 

17. If VARO80 (Percentage time devoted to non-intelligence 
outputs) was blank, then it was changed to "000". 

18. If VARO84 (Comments Continuation Code) was blank, 
then it was changed to "0" i£ VARO83 (Comments) was blank 


or changed to "1" if VARO83 was not blank. 


G. QICARDS VALIDATION 

Validation of the QICARDS file was not necessary because 
it resulted from a programmed merger of two files that had 
already been validated. QICARDS was a composite of the 


QCARDS and the ICARDS files. 


H. DICARDS VALIDATION 

The DICARDS file was listed using an ALGOL source program 
written for that purpose. That program is shown in Appendix 
F Sample A with a sample printed output. The control block 


information was printed in a readable format along with each 
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of the twenty output percentages on a Separate line. This 
program also checked to insure all twenty output percentages 
totalled 100%, as well as the following checks: 

1. VAR207 (Special Case Flag), cc 72, had to be a "0" 
or)". 

2. VAR208 (Defense Intelligence School Graduate Status), 
Sema, nad to be a "0", "1", or "2", 

3. VAR209 (DELPHI Response Validity Code), cc 74, had 
to be a "1". 

4. VAR210 (Card Eight, Sub-card 03 Number), cc 75-76, 
adeno be “O3". 

5. VAR212 (Card 8-03 Number), cc 80, had to be "8". 

This printout was then visually checked page-by-page 
against the oriyinal DELPHI Questionnaire from which the 
DICARDS were punched. Corrections were made by repunching 
the affected card(s). The corrected DICARDS file was then 


Placed on disk storage. 


I. D2CARDS VALIDATION 

The D2CARDS file was listed using an ALGOL source program 
written for that purpose. That program is shown in Appendix 
F Sample Q with a sample printed output. The control block 
information was printed in a readable format with each of the 
42 groups of three educational proficiency level codes on a 
separate line. This program also checked to insure each 
educational proficiency code was one of those listed in 


Appendix D Table D-9 as well as the following checks: 
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1. There had to be exactly two cards for each sequence 
or case number contained in the file and those two cards had 
to be in the proper order. 

2. VAR273 (Special Case Flag), card 04 cc 61, had to be 
amo or "1", 

3. VAR274 (DELPHI Response Validity Code), card 04 cc 
feamenacg to be a 1". 

4. VAR275 (Card Eight, Sub-card 04, Number), card 04 
ec 75-76, had to be a "04". 

5. VAR277 (Card 8-04 Number), card 04 cc 80, had to be 
ane. O « 

6. VAR344 (DELPHI Response Validity Code), card 05 cc 
74, Wad to be a "1". 

7. \VAR245 (Card Eight, Sub-card 05, Number), card 05 
cc 75-76, had to be a "05", 

8. VAR347 (Card 8-05 Number), card 05 cc 80, had to be 
ane 8". 

This printout was then visually checked page-by-page 
against the original DELPHI Questionnaire from which the 
D2CARDS were punched. Corrections were made by repunching 
the affected card(s). The corrected D2CARDS file was then 


placed on disk storage. 


J. DELITPS VALIDATION 
Validation was not applicable to the formatted letter 
cards which were used as the input file for the computer 


generated DELPHI Questionnaire. 
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PRINTING OF DATA FILES 


An ALGOL source program was written to print, in a reada- 
ble format, each variable of the basic data base QCARDS file. 
This program, listed in Appendix F Sample B was named DISPLAY 
for JCL purposes and was stored on the data disk because of 
its frequent use. The input file for the DISPLAY program 
was the QCARDS file and the program's output is exhibited 
in Appendix F Sample C. All information contained in the 
QCARDS file was displayed. 

Other than the utility and special ALGOL programs used 
in data file validation and the DISPLAY program mentioned 
@ee7e,) nC Schnee printing of the data base was accomplished 
by other than standardized utility and packaged programs. It 
should be noted that SPSS programs had the facility for printing 
variables from within the data base. This feature was used to 


the maximum extent possible. 
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DATA FILE GENERATION CHRONOLOGY 


A. BACKGROUND 

The following explanation traces, step-by-step, the file 
generation procedures. Each step utilizes the data declara- 
tions already presented and gradually builds toward a 
chronological construction/utilization analysis. Each step 
builds sequentially from the previous steps. The starting 


point is the basic data base module, i.e., the QCARDS file. 


B. ADDITION OF TRAINING AND ADDITIONAL OUTPUT DATA 
1. Discussion 
The respondents! training information [VAR019], and 
the five additional output code variables [VAR062, VARO65, 
VARO70, VARO7:, and VARO78] could not be coded at the time 
of the initial questionnaire coding. This was due to the 
fact that no general classifications were possible without 
having first considered all of the different types of code 
values needed. Delayed inputting of these variables resulted 
in a more precise evaluation of the specific requirements of 
those six variables. 
9. Execution 
An ALGOL source program was written which merged the 
three card image disk files QCARDS, ACARDS, and TCARDS. Only 
Ee output file was generated by this program. That output 
was an updated version of the QCARDS data file in the form of 


a newly punched card deck. The training information from the 
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TCARDS file and the additional output codes from the ACARDS 
file were inserted for each case prior to generating the new 
card deck. This Soaeln TEE also used for the revalidation 
process of the QCARDS file, a procedure already discussed. 
The TCARDS and the ACARDS files were unchanged by this program. 
The updated QCARDS punch deck was then placed on disk storage 
thereby overlaying the original QCARDS file. It was this new 
QCARDS file that was the input file for subsequent data base 
programs. The program used for this revalidation and merger 
was written in ALGOL and used FORTRAN input/output subroutines 
described in the discussion of "FOALG3". Appendix E Figure 


E-2 and Appendix F Sample D apply to these two programs. 


C. CREATION OF THE FIRST STATISTICAL PACKAGE 

After the updated QCARDS punched during the revalidation 
and merger program were placed on disk, the first SPSS 
statistical file creation program was executed. Using the 
"SAVE FILE" feature of SPSS, all 86 variables associated with 
the QCARDS file were retained on disk storage for subsequent 
analysis. This SPSS file was named the INTELLA file for JCL 


and SPSS purposes and is listed in Appendix F Sample E. 


D. COMPUTER PRINTED DELPHI QUESTIONNAIRE 
1. Discussion 
The 6 November 1974 DELPHI "A2" was concerned with 
further defining that amount of time which was spent on. 
each of the intelligence related outputs. The iterative 


DELPHI technique required a controlled feedback. In order to 
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provide each respondent with information concerning his pre- 
vious response, this data could have been extracted manually 
from the coding forms or electronically from the QCARDS file 
through the use of the computer. Further, a method was re- 
quired to verify the biographical information which had been 
coded in the basic data base file. As should now be obvious, 
each DELPHI Questionnaire was a unique entity. This unique- 
ness precluded the use of normal printing services and necessi- 
tated computer printing. The sample population was entirely 
too large to consider manual preparation. Although it may be 
argued, and with some justification, that excess complexity 
in this hardcopy preparation cycle overrode any accrued advan- 
tages in the DELPHI technique, two facts must be remembered: 
(a) the burden was to be placed on the computer, and (b) it 
was believed that high response ratios could only be achieved 
by communicating on a personal level with the sample popula- 
tion. Once the use of this DELPHI technique with such a large 
sample population was proven feasible, was debugged, and was 
made operational, a new and more effective method would be 
available to others attempting similar projects. 

2. Assemblying the DELPHI Questionnaire 

After the DELPHI "A2" format was established, the 

basic letter was transposed into punched cards using the TPS 
coding scheme deScribed in Appendix F Sample F. Only columns 
11-80 were used for this textual material. For each place in 


the formatted letter which required information from or deletion 
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of certain textual material based on the data base variables, 
there was a card coded with a sequentially numbered program 
entry block. This program entry block number was the three 
digit number in card columns seven through nine, coupled with 
the program control signal, an asterisk, punched in column 
ten. An ALGOL program, listed in Appendix F Sample G, then 
accomplished a specific transformation based on Boolean deci- 
Sions from data base information. Each QCARDS case was read 
in an ALGOL control, and then the ALGOL program reconciled 
the formatted letter against each case. The finai TPS for- 
matted letter card file used for this program was labelled 
DELITPS for JCL purposes and is listed in Appendix F Sample H. 
The additional support files utilizec& in the ALGOL program 
were the MAILER file for addressing information, and the 
QCARDS file. 
3. Printing the DELPHI Output 

The primary output from this ALGOL/FORTRAN/TPS com- 
bination was a file of over 100,000 card images which was 
used in a normal TPS printing program on unruled bond paper. 
Approximately 1490 pages of upper and lower case DELPHI Ques- 
tionnaires were printed. Example DELPHI Questionnaires are 
shown in Appendix B Sample E. It is interesting to note that 
this printer file was the only one which was not contained on 
the SYS003 disk file. It was too large to fit on the 200 
cylinders of a Model 2311 disk unit, even with the maximum 
blocking factor available. The Model 2321 Data Cell storage 


equipment was uSed for this file. 
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Two secondary files were also generated during the 
preparation of the DELPHI Questionnaire. These were for the 
two address labels used on the mailing and return envelopes. 
Four labels were produced per DELPHI Questionnaire: one 
large and one small label each with the respondent's command 
name and mailing address and with the respondent's name 
included on the larger of the two; and one large and one 
small address label each with the Naval Postgraduate School's 
address. The three digit sequence number was included on 
each address label as an extra precaution for questionnaire 
identification should the respondent's name accidentally be 
removed from the body of the questionnaire. The resulting 
questionnaire was the ultimate in simplicity since each respon- 
dent was only required to fill in the information specifically 
requested. He then returned the DELPHI in the self-addressed 
envelope provided. The labels produced were of the machine 
printed adhesive, press-to-apply variety. The large labels 
were Federal Stock Number [FSN] 7530-082-2662; the smaller 
labels were FSN 7530-082-2661. The FORTRAN program used for 
printing the labels and sample labels are shown in Appendix 


F Sample I. 


E. INTERVIEW DATA INSERTION 
1. Discussion 
The QCARDS file with seven card images per case was 


merged with the variable length ICARDS file to produce the 


365 





QICARDS file. This new file contained exactly nine cards 
per case: the basic seven card base with two formatted 
interview data cards for each case appended. 
2. Execution 

An ALGOL source program, Appendix F Sample J, was 
written to read each QCARDS case and duplicate that seven 
card image block identically on an output file uSing the FOALG3 
input/output FORTRAN subroutines (Figure E-2). The ICARDS 
file was then rewound and searched card-by~card for any and 
all records which had the same sequence or caSe number. If 
no ICARDS image was found, a dummy 46x2 education matrix was 
generated with control block information added for continuity. 
Two dummy educational proficiency level card images were then 
appended to the output file. This dummy matrix was essentially 
filled with "9's". If at least one ICARDS entry was found for 
the case being processed, this same 46x2 educational profi- 
ciency level matrix was constructed using all applicable ICARDS 
images. Any unused educational codes were forced to a "1" 
code indicating an unused or unneeded level. Two valid card 
images were then appended to the output file. A single 
ICARDS for the case being processed was sufficient to indicate 
that an interview had taken place. A dummy education matrix 
was Signified by a "9" value for VAR133 and VAR183 [Interview 
Coder Number variables], whereas a valid education matrix 
resulted in those two variables containing a valid researcher 


code number from Appendix D Table D-4. 
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F. CREATION OF THE SECOND STATISTICAL PACKAGE 

After the merged QCARDS/ICARDS file was available on the 
data disk, the second SPSS statistical file creation program 
was executed. Using the "SAVE FILE" feature of SPSS, all 
186 variables associated the QICARDS file were retained on 
disk storage for subSequent analysis. This SPSS file was 
named the INTELLB file for JCL and SPSS purposes and is listed 


in Appendix F Sample K, 


G. SECOND DELPHI QUESTIONNAIRE MAILING LABEL PREPARATION 
1. Discussion 
The 17 December 1974 DELPHI "B" concerned the current 
and changing educational requirements of naval intelligence. 
This DELPHI Questionnaire was produced using regular printing 
services of the Educational Media Department at the Naval Post- 
graduate School. A copy of this questionnaire is shown in 
Appendix B Sample C. The large space between the date and 
the first paragraph was used for large address labels which 
had the command name and mailing address printed on the upper 
lines, and the persons' name in a "Greeting Format" on the 
bottom line. 
2. Execution 
The ALGOL program logic used to print the computerized 
DELPHI Questionnaire was extracted and slightly modified for 
the preparation of these lables. Again, two different size 
labels were produced. As each QCARDS case was read, three 


large labels and two small labels were produced. The first 
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four labels were similar to those produced in previous programs, 
phe additional fifth label was the "Greeting Format” > emg. , 
the last line read "DEAR LCDR JONES:", 

The only two input files needed for this ALGOL pro- 
gram were the QCARDS and the MAILER files. Printing was 
accomplished by the same simple FORTRAN program used in 


earlier programs and is shown in Appendix F Sample I. 


age 6 NOVEMBER 1974 DELPHI DATA INSERTION 
1. Discussion 
The QICARDS file with nine card images per case was 
merged with the DICARDS which resulted from the 6 November 
1974 intelligence outputs DELPHI Questionnaire. This new 
file, named the OIDICDS file, contained ten card images per 
case, 
ea EXecution 
An ALGOL source program, Appendix F eompie L was 
written to read each QICARDS case and duplicate that nine 
card image block identically on an output file using the 
FOALG3 input/output FORTRAN subroutines (Figure E-2). When 
necessary, the DICARDS file was rewound, and then that file 
was searched card-by-card for a card image with the same se- 
quence number. If no DICARDS image was found, a dummy record 
was generated internally with control block information added 
for continuity and then this dummy record was placed on the 


output file. A dummy record was essentially all "9's" with 
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VAR209 becoming a "0" value to indicate a dummy record. If 
a DICARDS image was found for the sequence number being pro- 
cessed, that record was placed on the output file without 


being altered. VAR209 was a "1" in those instances. 


t. CREATION OF THE THIRD STATISTICAL PACKAGE 

After the merged QICARDS/DICARDS file was available on 
the data disk, the third SPSS statistical file creation pro- 
gram was executed. Using the "SAVE FILE" feature of SPSS, 
all 212 variables associated with the QID1CDS file were re- 
tained on disk storage for subsequent analysis. This SPSS 
file was named the INTELLC file for JCL and SPSS purposes 


and is listed in Appendix F Sample M. 


J. 17 DECEMBER 1974 DELPHI DATA INSERTION 
ive DIScussion 
The QID1CDS file with ten card images per case was 
merged with the D2CARDS which resulted from the 17 December 
1974 educational proficiency level DELPHI "B". This new 
file, named the QID12CDS file, contained twelve card images 
per case. 
2. Execution 
An ALGOL source program, Appendix F Sample N was 
written to read each QIDICDS case and duplicate that ten 
card image block identically on an output file using the 
FOALG3 input/output FORTRAN subroutines (Figure E-2). When 


necesSary, the D2CARDS file was rewound, and then that file 
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was searched two cards at a time for a match with the same 
sequence number that was being processed. If no D2CARDS 

images were found, two dummy records were generated internally 
with control block information added for continuity. These 

two dummy records were then placed on the output file. The 
dummy records were essentially all "9's" with VAR274 and VAR344 
becoming a "0" to indicate a set of dummy records were entered 
in the file for that case. If the D2CARDS file contained a 
match for the case, those two records were placed on the output 
file without being altered. VAR274 and VAR344 were a "1" in 


those instances. 


K. CREATION OF THE FOURTH STATISTICAL PACKAGE 

After the merged GID1LCDS/D2CARDS file was available on 
the data disk, the fourth SPSS statistical file creation pro- 
gram was executed. Using the "SAVE FILE" feature of SPSS, 
all 347 variables associated with the QID12CDS file were re- 
tained on disk storage for subSequent analysis. This SPSS 
file was named the INTELLD file for JCL and SPSS purposes 


and is listed in Appendix F Sample O. 


feecLOSURE OF THE DATA FILES 

Upon completion of the initial analysis of the data and 
return of the data disk to the computer center for other 
users, all files of historical interest were punched onto 
cards. The punched cards were transferred to the custody of 


the Naval Intelligence Curriculum Officer (Code 382) at the 
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Naval Postgraduate School. Additionally, the INTELLD file 
was .cosmetically eleanedeme. renamed the INTELL file, and 
then transferred to tape for storage. All information re- 
ceived from the respondents through 28 February 1975 was 
placed in the final INTELL statistical package. The program 
and file listings required to reconstruct the entire data 
base are contained within the appendices of this thesis. An 
80 column listing of the last working file, the QID12CDS 
file, is contained in Appendix F Semple P with only the 
researchers’ comments [VARO83, card number seven, card 


columns 1-75] deleted. 
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APPENDIX F 
SAMPLE A 


ALGOL SOURCE PROGRAM 


TO PRINT AND VERIFY DICARDS, 


WITH SAMPLE OUTPUT 
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APPENDIX F 
SAMPLE B : 


ALGOL SOURCE PROGRAM TO DISPLAY 
BASIC DATA BASE CARDS 
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EXAMPLE OUTPUT FROM ALGOL DISPLAY PROGRAM 
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APPENDIX F 
SAMPLE S 
COMPUTERIZED METHOD OF SUCCESSIVE INTERVALS 


Monroe Model 325 computer program to perform ordinal-to-interval 
data conversion using Torgerson's method of successive intervals 
applied to the Law of Comparative Judgment. 


Program Block One accepts the input data and calculates certain 
probabilistic values. After rewinding the data tape written by 
block one, program block two calculates the standard normal 
deviates for each of the relative frequencies. An approximaticn 
to the inverse normal distribution given by Abramowitz and Stegun* 
is used for these calculations. After rewinding the data tape 
from the second program block, block three produces the interval 
scale values for each of 42 educational areas. 


Register assignments for each program block follows: 


Register # Block 1 Block 2 Block 3 
0 cumulative N(G,1l)e ty 
relative cell 4 
frequency, 
cell 4 
aL cumulative 107 t3 
relative cell 3 
frequency, 
cell 3 
2 cumulative N(0,1), ts 
relative cell 2 
frequency, 
cell 2 
3 cumulative row total row mean 
relative 
frequency, 
cell l 
4 row sum column 4 sum column 4 sum 
5 unused column 3 sum column 3 sum 
6 unused column 2 sum column Z sum 
7 unused unused A 
8 unused unused mean t 
9 counter counter counter 
d counter switch B. 
s scratch t work unused 


* Refer to formula #26.2.23 for the rational approximation 
where the error is less than 4.5x10""*. 
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APPENDIX G 


EMPIRICAL DATA PRESENTATION 


A. PRESENTATION OF ORGANIZATIONAL PARAMETER DATA 


VAROO1 


VAR002 


VARO0 3 


VARO04 


VAROO5 


VARO06 


"Command Name" - Of the 119 commands which received 
the original questionnaire, 99 commands [83.2%] had 
at least one respondent. 

"Billet Sequence Code" - No meaningful statistic 
exists. 

"Billet Title" - A listing of billet titles was used 
by the researchers only to gain an insight into a 
biitlet's function . 

"Unit Identification Code" - No meaningful statistic 
exists. 


"CONUS/Overseas Code" - 


Code # of cases %$ of total 
Continental uss. 220 67.73% 
Europe 24 7.4% 
Pacie1e 66 20.3% 
Atlantic/Med Afloat Tal Gls 
Pacific Afloat 4 Lea2s 
325 
"Country Code" - Geographically, responses were 


received from ten states, Washington, D.C., eight 
foreign countries, four U.S. protectorates, and forces 
afloat in the Atlantic, Pacific, and Mediterranean. 
The breakdown by the number of cases represented in 


each category is as follows: 
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Code # of cases % of total 


United States 261 80.3% 

Foreign countries 43 3.2% 

Afloat 15 4.6% 

Protectorates eS 1.9% 
325 


VARO16 "Billet Subspecialty Code" - Of the 319 military 
respondents, only 126 [39.5%] reported that their 
billet called for a specific subspecialty. The 


following breaks down those billet subspecialty codes 


reported: 

Code © # of cases % of 126 cases % of 319 military 
7210 91 72.2% 28.53 
7120 3 2.4% 0.9% 
9670 3 2.4% 0.9% 
2710 2 1.6% 0.63 
7110 2 1.6% 0.63 
8110 Zz 1.6% 0.6% 
9640 2 1.63 0.6% 
Others 21 16.6% 6.6% 

126 


B. PRESENTATION OF PERSONAL PARAMETER DATA 


VARO10 "Respondent's Name" - No meaningful presentation. 
VARO03 “Billet Title" - Refer to organizational parameter 
data. 


VARO11 "Respondent's Rank - 


Code # of respondents % of total 

Civilian 6 1.9% 

Lieutenant 7 Ay PRR + 

Lieutenant Commander 17s 53.83 

Commander 97 29.83 

Captain 40 Leese 
325 
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VARO12 "Respondent's Age" =- 


Code Mean Age Std. Deviation 
Civilian 25.7 10.8 
Lieutenant 29.9 PrA 
Lieutenant Commander 36.2 ee 
Commander 40.9 226 
Captain 46.6 325 
Overall for respondents $9:.0 5.2 


(Note: only 317 respondents provided age information) 


VARO13 "Respondent's Designator" = 


Designator # of respondents % of military total 
1630 186 58 .3% 
1110 Al 12.6% 
IL Silco 28 8.83 
1120 20 6.3% 
1637 y 202% 
635 6 1.9% 
1610 6 1.9% 
1320 5 1.6% 
6632 2S 0.9% 
6622 2 0.6% 
1100 2 0.6% 
1350 il 0.3% 
1510 iL 0.33 
1636 aL 0.3% 
1810 ul 0.3% 
5100 a 0.3% 
6462 7 0.3% 
6631 IL hg GES 
Unspecified designators 6 1.9% 
319 military 
VARO]4 “Respondent's Previous DeSignator" - Of the 319 


military respondents, 194 [60.8%] reported having had 
at least one designator prior to their present 
designator. The following percentages are based on 


the 194 total reporting previous designators. 
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Previous Designator # of respondents %of 194 total 


1350 75 38.78 
1100 40 20.6% 
1355 20 10.3% 
1635 16 2.22 
1105 9 4.6% 
1310 8 4.1% 
1120 7 3.63 
1110 5 2.6% 
1315 3 1.5% 
1320 3 1.5% 
1357 3 1.5% 
1615 2 1.0% 
1325 i 0.5% 
1530 1 0.5% 
6621 i 0.5% 
194 


VAROLS5 Tesco eee First Designator" - Of the 319 military 
respondents, 52 [16.3%] reported having had at least 
two designators prior to their present designator. 
The following percentages are based on the 52 total 


reporting at least two such designator changes. 


First Designator # of respondents $% of 52 tstai 
1355 dg: 32.7% 
1105 aS 28.8% 
1310 8 15.4% 
1100 5 9.6% 
1315 2 3a8% 
0 Ie Ue 
1120 iL 1, 2k 
L327 aL ee 
1350 1 L.9% 
1395 oe 1.9% 
52 


VARO17 “Respondent's Subspecialty Code" - A total of 32 
different respondent subspecialty codes were reported. 
The “other" category includes seven different codes 
with a frequency of two each, and 22 other codes with 
a frequency of two each, and 22 other codes reported 


only once. 
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Subspecialty Code # Of Kespendentom =f OF 39 mulitary 


7210 oul 16.0% 
7160 5) 1.6% 
9210 4 1. 3% 
Dre (29editterent codes) 36 11.3% 

96 reported 30.2% 


VARO1]8 "Respondent's Education Level" - 


Level reported # of respondents 3 of total 
Less than a bachelors 21 6.5% 
Bachelors degree 168 oles 
Postgraduate studies | 41 12.6% 
Masters degree 83 29.98 
Pieb S| 0.9% 
level not reported 9 2.8% 
825 
VARO19 "Training Used in Billet" - For a complete explanation 


of the training codes used refer to Table D-7 in 
Appendix D. Categories are not mutually exclusive 


and a respondent may be recorded more than once. 


Training Used Category % Frequency 
Previous intelligence experience 10.1% 
Previous military experience 8.0% 
DIS/NIS [data invalid; cf. VAR208] 
Photointerpretation/photographic 5.2% 
experience 
Intelligence training courses o.5e 
Foreign language training Pee re 
ADP training or experience 5.83 
Professional military education 5.8% 
Professional training 9.2% 
VAR208 "Defense Intelligence School Graduate" - A "3" code 


in VARO19 was combined with data in VAR208 to produce 


these statistics. 


DIS/NIS graduate? # of respondents 2 On totel 

Yes 139 42.8% 

No 141 43.4% 

Status unknown 45 13.8% 
220 
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VAR020 


VARO21 


VARO22 


"Respondent's First Intelligence Billet" - 


First intelligence tour? # of respondents % of total 


Veo. first 44 13.5% 

No, not first 278 85.5% 

Status unknown 3 0.9% 
225 


"Years Previous Intelligence Experience" - 


Mean Standard Deviation 
8.1 years 6.0 years 


"Months in Billet" - 


Mean Standard Deviation 
16.9 months 14.5 months 


C. PRESENTATION OF FUNCTIONAL PARAMETER DATA 


VARO003 


VARO11 


VAR013 


VARO16 


VARO19 


"Billet Title" - Refer to organizational parameter 
Gata 

"Respondent's Rank" - Refer to personal parameter 
data. 

"Respondent's DeSignator" - Refer to personal 
parameter data. 

"Billet Subspecialty Code" - Refer to organizational 
parameter data. 

“Training Used in Billet" — Refer to personal 


parameter data. 


VAR0O25-VARO58 “Output Variables from First Iteration of 


Delphi A" - The aggregate results for the output 
variables are listed in Table G-l1. Column 1] contains 
the variable number; column 2 lists the variable name; 


column 3 presents the percentage of respondents 
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VAR061-VAR066/VAR069-VARO74/VAR077-VARO79 


VARO 80 


indicating more than zero percent of their time 


working on that output; column 4 is the mean time 


spent in conjunction with that output by those 


respondents listed in column 3. 


The even variable 


numbers from VARO26 through VARO58 indicated the 


measure Of applicability of the associated output 


to the naval intelligence community. These variables 


were not used in the research. 


"Additional Outputs - 


First, Second, Third, Fourth, and Fifth" - 


# of % of 325 
responses respondents 
First additional output 138 42.5% 
Second additional output 58 17.8% 
Third additional output 32 9.83 
Fourth additional output 14 4.3% 
Di teeeeeeeteloneal output ee Lore 
247 


"Percentage Non-Intelligence Related Outputs" - 


VARO80 was not considered reliable because of two 


factors: (1) questionnaire responses often indicated 


that the percentage of time alloted to non-intelligeiice 


related outputs was derived by summing all other output 


percentages and subtracting from 100%; and (2) the 


second source of error was entered by the researchers, 


VARO80 being altered if a discrepancy existed in the 


questionnaire response [e.g., if the total percentage 


of a questionnaire did not equal 100% then VARO80 was 


changed to make the total correct]. VARO80 was not 


used in any analysis of the data. 
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VAR187-VAR206 "Output Variables - Second Questionnaire" - 


Table 2 in the data presentation section lists the 
aggregate results for the second iteration output 
variables in the same format as Appendix G, Table 
G-1. VAR205 ["Non-Intelligence Related Outputs"] 
was omitted for the same reasons that were discussed 


in the previous section concerning VARO80. 


D. PRESENTATION OF EDUCATIONAL PARAMETER DATA 


VAR012 


VARO16 


VARO17 


VARO18 


VARO19 


VAR208 


"Respondent's Age" - Refer to personal parameter data. 
"Billet Subspecialty Code" - Refer to organizational 
parameter data. 


"Respondent's Subspecialty Code" - Refer to personal 


"Respondent's Education Level" - Refer to personal 
parameter data. 

'Traimang USed in Billet” — Refer to personal 
parameter data. 

"Defense Intelligence School Graduate" - Refer to 


personal parameter data. 


VARO87-VAR132 “Interview Data - Educational Levels USED" - 


The results of the 103 interviews pertaining to USED 
educational levels is displayed in Table G-2. Columns 
3, 4, 5, and 6 represent the levels subjectively 
evaluated by the researchers as that being used by 

the billet holder in the performance of his duties. 
The column level values are defined in Table D-9 of 


Appendix D, and basically are defined as: 
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le not used 


"2" = basic knowledge 
"3" = working knowledge 
"4" = expert knowledge 


VAR137-VAR182 "Interview Data - Educational Levels NEEDED" - 
The results of the 103 interviews pertaining to 
NEEDED educational levels is displaved in Table G-3. 
Columns 3, 4, 5, and 6 represent the levels subjectively 
evaluated by the researchers as that being needed by 
the billet holder in the performance of his duties. 
The column level values are defined in Table D-9 of 


Appendix D, and basically are defined as: 


"1" = not needed 

"2" = basic knowledge 
"3" = working knowledge 
"4" = expert knowledge 


VYAR213-VAR343 "Delphi 'B' Data - Educational Levels - USED, 
NEEDED, and FUTURE" - These variables were used to 
obtain each respondent's estimate of the level of 
educarron. (1) that hesUskb invthe performance of his 
billet tasks [Table G-4], (2) that he NEEDED to 
properly perform his billet tasks [Table eB). and 
(3) his prediction of the levels that will be needed 
ten years in the FUTURE [Table G-6]. The Delphi data 
represents the respondents' subjective judgments of 
the same educational areas coded from the interview 
data. Again, columns 3, 4, 5, and 6 represent the 
levels evaluated by the respondents with the same 
coding scheme defined in Table D-9 of Appendix D and 


used to describe the interview data. 
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APPENDIX H 


80-COLUMN PRINT OF "INTELL" DATA BASE 
(QID12CDS) 
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